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Preface 


r 


This  thesis  investigates  the  application  of  a 
gradient  method  and  a ccmblned  gradient-differential 
dynamic  programming  method  to  generate  a closed-loop 
control  law  for  Intercept  problexos  formulated  as 
differential  games.  The  two  example  problems  presented 
In  this  report  are  somewhat  simplified  and  serve 
mainly  to  test  the  methods.  It  Is  expected  that  the 
general  results  will  carry  over  In  a satisfactory 
manner  to  problems  with  more  complicated  dynamics. 

My  sincere  appreciation  goes  to  Prof.  Gerald 
M.  Anderson  for  his  advice  and  guidance  In  this  effort 
and  to  my  wife,  Lynn,  for  her  encouragement  and 
endxirance  of  many  lonely  hoiirs  dxirlng  the  preparation 
of  this  work. 

This  thesis  is  dedicated  to  Gapt.  Arthur  J.  Brandt 
whose  tragic  death  grieved  all  of  us  in  the  GA-76D 
class,  to  my  trlfe  Lynn,  and  to  my  son  Kyle. 


i 


I 

I 


I 


11 


Contents 


Page 

Preface 11 

Llat  of  Figures v 

List  of  Tables vl 

List  of  Symbols vll 

Abstract lx 

I.  Introduction 1 

Background  1 

Statement  of  the  Problem 3 

II.  Differential  Game  Formulation  and 

Closed-Loop  Control  Laws 4^ 

A Gradient  Closed-Loop  Control 

Law  ••••.••  7 

A Differential  Dynamic  Programming 
Closed-Loop  Control  Law  .....  13 

( Game  Simulation  .........  16 

III.  Planar  Relative  Motion  Pur suit -Evas! on 

Game  l3 

Game  Formulation  .........  l3 

Application  of  Necessary 

Conditions . 20 

Closed-Loop  Controls  .......  21 

Results  22 

IV.  Three  Dimensional  Interceptor- 

Penetrator  Game 27 

Game  Formulation 27 

Application  of  Necessary 

Conditions  30 

Closed-Loop  Controls  .......  32 

Results 33 

V.  Conclusions 4-2 

Bibliography 44- 


0 


Appendix  A:  Derivation  of  an  Analytic  Cloaed- 
i Loop  Control  Law  45 

Appendix  B:  ABM-ICBM  Duel 46 

Appendix  C:  Program  Listing:  A Closed-Loop 
Gradient  Control  Update  Algorithm  (Roal-Time 
Implementation)  56 

Appendix  D:  Program  Listing:  A Closed-Loop 
Gradient-DDP  Control  Update  Algorithm  (Not  Real- 
Time)  62 

Vita 70 


( 


List  of  Figures 


Figure  Page 

1 Control  Implementation  Time  Line  ....  1? 

2 Planar  Pvirsult-Evaslon  Game  Geometry  , , 19 

3 Planar  Pur suit -Evas ion  Game 

Trajectories  2k 

4 Interceptor-Penetrator  Game  Geometry  , , 28 

5 Minimum  Range  and  Cost  vs.  Sampling 

Interval 35 

6 Minimum  Range  and  Cost  vs.  Sampling 

Interval 35 

7 Mlnimvon  Range  and  Cost  vs.  Sampling 

Interval 36 

6 Minimum  Range  and  Coat  vs.  Sampling 

Interval 36 


C 


List  of  Tables 


Table 

Page 

1 

Variance  In 
Factor  • • , 

Cost  with  Convergence 

25 

2 

Variance  In 

Cost  with  Sampling  Interval, 

25 

3 

Sensitivity  to  Initial  Conditions  and 
Initial  Control  Guesses  

38 

4 

Sensitivity 

to  Thrust  Levels  ...... 

39 

( 


( ' 

▼1 


List  of  Symbols 


Symbol 

A 

£ 

H 

J 

Kc 

K, 

KovWTnA* 

L 

P 

T 

T, 

to 

■^5 


ir 

( • ) 
«<  HI 


Definition 

Predicted  Cost  Change 

Evader  (Maximizing  Player) 

Hamiltonian  function 

Cost  functional 

Weighting  Matrix  (Evader) 

Weighting  Matrix  (Pxirsuer) 

Maximum  allowable  number 
of  iterations 

Path  dependant  portion 
of  cost 

Pxirsuer  (Minimizing  Player) 

Target  on  Earth's  surface 

Evader's  constant  thrust 

Pxirsuer's  constant  thrust 

Terminal  (final)  time 

Initial  time 

Saoqpllng  time 

Minimizing  player's 
control  vector 

Maximizing  player's 
control  vector 

‘ State  vector 

Differentiation  of  ( ) 

%rith  respect  to  time 

The  Euclidean  norm  of 

( ) 


vll 


( )l 

( )—  ( 
S(  ) 

A 

€ 

0 

'X 


Evaluation  of  ( ) 

along  a nominal  path 

( ) goes  to  ( ) 

Small  variation  in  ( ) 

Sampling  Interval 

A small  number 

Costate  vector 

Terminal  cost 

Time~to-go 


Subscripts 

£ 


Denotes  Evader  (maximizing 
player) 


I 

I 

ffonon 


Terminal  value 

Inertial  coordinate  axis 
fixed  on  Earth's  surface 

The  1 component 

Denotes  non-optimality 

Denotes  nominal 


P 


V 


'H 


Denotes  Pursuer  (minimizing 
player ) 

Partial  differentiAtlon 
with  respect  to 

Partial  differentiation 
with  respect  to 

Partial  differentiation 
trith  redpect  to  /p 


Superscript 

» 


T 


Denotes  optimality 
Transpose  operation 


OA/MC/76D-2 


Abstract 

This  thesis  Investigates  the  use  of  a gradient 
method  and  a combined  gradient-differential  dynamic 
programming  (DDP)  method  to  generate  closed-loop 
controls  for  intercept  problems  formulated  as 
differential  games.  The  gradient  method  is  applied 
to  a planar  motion  pursuit-evasion  game.  The  trajectory 
obtained  compares  favorably  with  that  obtained  using 
analytic  expressions  for  closed-loop  controls.  The 
gradient  method  is  applied  to  a three  dimensional 
interceptor-penetrator  game  with  simplified  dynamics  on 
a real-time  basis.  A combined  gradient-DDP  algorithm  is 
applied  to  this  problem  but  not  on  a real-time  basis. 

The  DDP  portion  of  this  combined  control  law  was  fovind 
to  be  tinstable.  The  results  obtained  indicate  that  a 
gradient  based  scheme,  because  of  its  nvimerical  stability 
and  ability  to  rapidly  converge  to  the  vicinity  of  the 
optimum,  may  bo  used  to  generate  an  effective  nea:  optimal 
closed-loop  control  law  for  some  problems. 


CLC'SKD-LOOP  CONTriOLS  l-'Ori  DI -•Vi-.rifJijTIAL 
Gjuiiio  USING  A Gii.’iDlKi'i'j.'  Al.D  A 
DII’i-'J^nEOTIAL  DYii.'UilG  ?ROG:{/-a JUNG  i-LEi'rlOD 

I , Introduction 


Backf^round 

Differential  gatae  theory  can  be  applied  to  many  problems 
where  tvio  participanl.s  have  diarae  trie  ally  opposing  goals. 

Many  problems  encountered  in  the  area  of  military  strategy 
can  be  modeled  as  a two-person  zero-sum  garae. 

In  a zero-suin  gaiae,  one  player  auplies  a control  in 
an  effort  to  minimize  a cost  (performance  index)  and  the 
other  player  ap;jlies  a control  to  maximize  the  cost. 

Application  of  necessary  conditions  for  a saddle  point 
solution  to  the  game  will  yield  a two-point  boundary  value 
problem  (TP3VP)  which  must  be  solved  to  generate  the  optimal 
controls  for  both  players.  Solution  of  this  TPBVP  for  a given 
set  of  state  initial  conditions  will  yield  open-loop  strategies. 
Strategies,  or  control  laws,  so  obtained  are  useful  if  it 
can  be  assumed  that  both  players  \;ill  use  their  optimal 
controls  throughout  the  duration  of  the  game,  Unfoi*tunately , 
for  most  realistic  problems  this  is  an  invalid  assumption. 

In  order  to  use  differential  game  theory  in  problems 
of  aerial  combat  and  interception,  a closed-loop  control 
law  is  needed  so  that  one  player  may  iniraodiately  capitalize 
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upon  non>optlnial  play  by  his  opponent,  A computational 
algorithm  is  needed  to  provide  a closed-loop  control  law. 

If  one  of  the  players,  for  example  E (Evader),  uses 
a non-optlmal  control,  then  the  other  player,  p (Pursuer)., 
updates  his  control  vector  by  use  of  a computational  algorithm. 
To  accomplish  this  task,  P samples  the  system  state  at 
fixed  time  intervals  and  computes  new  controls  using  the 
saiiq}led  state  vector  and  computed  (or  assvimed)  nominal 
control  histories  for  both  players.  Between  sampling  times, 

P flies  open-loop  using  controls  computed  at  tht  previous 
sampling  time.  ^ 

Generation  of  a near-optimal  closed-loop  control  using 
nel^boring  extremal  algorithms  has  been  accomplished  with 
some  success  (Refs  1,2).  A major  drawback  to  using  these 
methods  is  that  they  require  the  use  of  a reference  trajectory. 
In  order  to  obtain  a reference  trajectory,  a TPBVP  must  be 
solved  and,  typically,  this  requires  a large  amount  of 
coz^putatlonal  time.  In  addition,  nvunerlcal  stability  of 
nel^borlng  extremal  methods  sometimes  causes  convergence 
problems. 

An  ideal  closed-loop  control  law  would  be  one  that  is 
stable,  depends  only  on  the  c\irrent  state,  reqxilres  no 
reference  trajecto^,  provides  an  optimal  or  near- optimal 
control  law,  and  can  be  Implemented  on  a real-time  basis. 
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statement  of  the  Problem 

Scope « This  thesis  will  investigate  the  use  of  a 
numerical  algorithm  based  upon  a gradient  scheme  that  meets 
the  above  criteria  and  may  be  used  to  generate  a near-optimal 
oloaed-loop  control  law.  Two  example  problems  are  presented 
to  test  this  method.  The  first  problem  is  a planar  relative 
motion  pur suit -evasion  game  and  the  second  is  a three 
dimensional  Interceptor-penetrator  game. 

Approach.  In  the  planar  pursuit-evasion  game,  the 
trajectoz*y  obtained  using  the  gradient  closed-loop  control 
law  will  oe  compared  with  the  trajectory  obtained  using 
analytic  expressions  for  the  closed-loop  controls.  The 
gradient  method  will  be  applied  to  the  interceptor- 
penetrator  game  on  a real-time  basis.  Effects  of  varying 
convergence  parameters  and  state  sampling  Interval  will 
be  studied.  A differential  dynamic  programming  (DDP)  method 
is  used  in  conjunction  with  the  gradient  method  in  an  effort 
to  generate  a more  accurate  closed-loop  control  law  for  the 
interceptor-penetrator  problem. 


II.  DlflVrontial  Kornulation  and 

Closed-Loop  Control  Laws 

Many  aerial  combat  and  interception  problems, 
including  the  two  problems  considered  in  this  thesis,  may 
be  formulated  as  two-person  zero-sura  differential  games. 

The  non-linear  system  dynamics  of  the  gajne  are  modeled 
using  a first  order  vector  differential  equation, 

9 

/%.  — T ( ^ .v)  (1) 

v/ith  initial  conditions 

/^(to)=  , (2) 

The  scalar  cost  functional  is 

tf 

J = 0[/X.(tf),tf]  L(o(.,u.,vr)  <££ 

u 

where  the  vector,  u,  contains  the  controls  of  the  minimizing 
player  and  the  vector,  v,  contains  the  controls  of  the 
maximizing  player. 

The  constmetion  of  a cost  functional  that  incorporates 
all  the  necessary  features  of  the  conflict  and  does  not 
bias  the  outcome  toward  one  player  is  a problem  in  itself. 

The  cost  used  in  pursuit-evasion  games  normally  includes 
some  meastire  of  the  range  between  the  two  vehicles  at  the 
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end  of  the  game.  Formulation  of  a payoff  for  other  types 
of  encounters  (e.g.  interceptor-penetrator)  within  the 
context  of  sero-sum,  two-person  games  is  more  difficult. 

The  optimal  solution  to  a zero-sum  differential  game 
depends  on  the  stationarlty  of  Equation  (3)*  Thus,  the 
problem  is  to  find  the  control  pair  (u*,  such  that 

J(wu*,ir)  ^ vr*)  ^ J(io,  v**)  ^ 

The  middle  term  of  (if.)  is  known  as  the  value  of  the  game 
and  an  asterik  («)  denotes  the  optimal  natiire  of  the  control 
vector.  This  inequality  is  called  a game  theoretic  saddle 
point  and  incorporates  the  idea  that  if  one  player  uses  a 
control  other  than  the  optimal,  then  the  other  may 
capitalize  upon  this  to  cause  a change  in  the  value  of  the 
game  to  his  favor. 

For  a game  with  no  terminal  state  constraints,  the 
necessary  conditions  for  a saddle  point  solution  to  the 

game  are 


II 

) /x(t,)  = /»■* 

(5) 

-H, 

1 — 1 
<*- 

V I 

II 

(6) 

X 

f 

II 

o 

(7) 

- 

(8) 
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r 


M. 


H^  = 0 (9) 

^ O (10) 

H(t^)=  - <i>^  (11) 

i^ere  the  Hamiltonian,  H,  la  defined  aa 

u,, it)  = L( v)+ )i^f(oc,u/,irj  , (12) 


If  there  la  no  path  coat,  then  L la  zero  In  Equatlona  (3) 
and  (12),  A derivation  of  theae  neceaaary  conditlona  la 
given  In  Chaptera  2 and  9 of  Reforonce  3,  The  TPBVP  that 
muat  be  aolved  la  given  by  Equations  (5)  and  (6).  Expresaiona 
for  the  optimal  control a In  terma  of  the  atate  and  adjoint 
varlablea  are  obtained  from  Equatlona  (7)  through  (10). 
Equation  (11)  determlnea  the  time  at  which  the  game  termlnatea 
and  can  be  ahown  to  be  equivalent  to  the  expreaalon 

j = 0 . 03) 

If  the  final  time  la  preapeoifled,  then  Equation  (11)  may 
be  omitted. 

Solution  of  the  TPBY?  will  yield  open-loop  control 
atrateglea,  (u*,  v*),  idiioh  repreaent  the  "beat”  one  player 
can  do  agalnat  the  "beat”  of  hla  opponent.  If  the  opponent 
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ohooaes  to  use  a control  other  than  v , then  the  first 
player  must  update  his  control  based  on  the  current  system 
state  and  time.  This  results  In  a closed-loop  control  law. 

A quality  of  two-person  zero-sum  games  is  that  if  both 
players  use  their  optimal  controls « then  the  open-loop 
and  closed-loop  trajectories  are  identical. 

A Gradient  Closed-Loop  Control  Law 

Adjoining  the  system  dynamics.  Equation  (1),  to  the 
scalar  cost  functional.  Equation  (3)»  by  use  of  time  varying 
LaGrange  multipliers  (adjoint  variables),  one  has 

Substituting  for  the  Hamiltonian,  Equation  (14)  becomes 

M 

tfl+j  [ . (15) 


Along  nominal  state  and  adjoint  variable  trajectories,  z 

and  X,  a variation  in  the  controls  from  the  nominal  controls 

u , v_  results  in 
o o 

J+SJ*  , tfl 

, v*"*  S V ) ” OL  IJt  . 


(16) 


ilxpansion  of  Equation  (16)  in  a Taylor's  scries  tarough 
f rst  order  tcrxas  about  the  noxainal  values  yields 

tr 


^ J “ /[  Su,  + Hvl  SvJ  it 

y o Q 


(17) 


which  is  the  first  order  variation  in  the  cost  duo  to 
aiuall  control  changes  Su  and  Sv  (Ref  4)»  The  adjoint 
variables  used  in  Equation  (17)  nust  satisfy  the  expressions 
given  by  Equations  (6), 

In  a differential  game,  player  P applies  a control 
change,  S u,  in  an  attempt  to  minimize  the  cost.  Player 
E is  assvuned  to  be  applying  a control  change,  S v,  to 
maximize  the  cost.  Therefore,  in  Equation  (17) » the  i 
component  of  the  vector,  Su,  is  adjusted  so  as  to  be  of 
opposite  sign  of  the  i^  component  of  the  vector, 

Likewise,  the  i^^  component  of  the  vector,  Sv,  is  adjusted 
so  as  to  be  of  the  same  sign  as  the  i*'  component  of  the 
vector,  This  procedure  ensures  that  the  opposing  players 

are  ma.:ing  control  changes  so  as  to  cause  a change  in  the 
cost,  5J,  to  their  favor. 

To  use  the  gradient  met'nod  to  generate  a closed-loop 
control  law,  the  control  corrections,  Su  and  &v,  are  computed 
at  discrete  sanoling  times.  At  each  sampling  time,  t^,  the 
gradient  closed-loop  control  algorithm  will  be  called  upon 
by  player  P to  generate  an  updated  control  based  upon  the 


C 


e 


annplcd  str.tG  vector.  The  coot  variance  over  the  time 


intoi'val,  t^  - t , (tlic  predicted  tino-to-^^o)  ia  (p'.ven  by 

X s 


SJ  - I [HjSoe  + 


(IB) 


The  control  corrections  made  on  each  Iteration  of  the 
algorithm  are  computed  vjith 


KpH 


oo 


and 


— Kf  Hx/-  f where  (19) 

and  K,.  are  diagonal  lieighting  (step-size)  matrices  of 

r 

proper  dimension  to  make  (19)  conformable,  Kp  and  are 
selected  so  that  Kp  ^ 0 (negative  definato)  and  K^,  > 0 

(positive  definato), 

S^le£tion  of  the  Step-Size,  Gradient  methods  are  inherently 
stable  and  converge  to  the  general  vicinity  of  a local  optimal 
solution  within  a few  iterations  if  the  step-size  matrices, 

Kp,  and  Kp,  are  selected  properly,  Leatham  (Ref  4)  suggests 

using 

MAX 

(Kf  )a  “ ( ^v-JriAy/ ( 

where  ( and  ( largest  control 
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corrections  that  the  designer  estimates  could  be  applied 


on  each  iteration.  (H^  and  (H^  are  the  maximxun 

control  gradient  magnitudes  which  are  estimated  values  for 
the  first  Iteration  and  updated.  If  necessary,  on  subsequent 
Iterations.  This  provides  a simple  method  for  taking  a 
variable  step-size  to  aid  convergence. 

An  alternate  method  of  computing  Kp  and  arises  by 
the  Inclusion  of  second  order  terms  in  Equation  (17).  In 
doing  this,  the  cost  change  over  the  predicted  tlme-to-go 
(tj  - t^)  becomes 


( 


S J ~ j [ Su,  + S 
*1 

Hyl  Sv  + Sv^  Hy-vl  SV  ] it 


(21) 


For  the  variation  to  vanish.  It  is  necessary  that 


• o 

[ Hvl  ^vv]  ] Sv"  = 0 


(22) 


FToai  Equations  {22)  the  coutrol  corrections  are  found  to  be 


Su.  Hu.]| 


(23) 


c 
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exist 


In  this  cs.se,  the  terns 


-1  -1 

provided  ,snd 

“1 

uu  ~“vv  o.mlo"ou3  tc  ana  Kp  in  x:;quations  ( IV). 

Convcrr.ence  oT  the  Gradient  hetli^^d.  In  this  thesis, 
convergence  of  the  ni'adient  nethod  is  defined  to  occur 
when  the  squrire  of  the  lluclidean  norms  of  the  gradient 
vectors  and  at  tho  sanpling  tine  are  both  less  than 
soiae  small  number.  That  is, 

6 £ and 

IIHv(t.)ll^  - . (2k) 

Convergence  can  also  be  defined  to  occur  when  S J in  Equation 
(18)  is  small, 

A Gradient  Method  Control  Update  Algoritlun,  For  a 
free  final  time  problem  with  no  terminal  state  constraints, 
the  algorithm  used  in  this  , thesis  is  stirarriarized  as  follows; 

(1)  From  the  current  state  and  sampling  time  (x{t  ) 

and  t,, ) Integrate  the  state  equations  forward 

« 

until  J— »-0,  This  establishes  a predicted  final 
state  and  tirae  (x(tp)  and  t^).  Use  the  ctu*rezat 
nominal  control  histories  u^  , in  this  integration. 
The  u and  v used  for  the  first  iteration  at  the 
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first  sample  time  must  be  chosen  by  some  reasonable 
logic  (e.g.  proportional  navigation  or  line  of  sight). 

(2)  Evaluate  the  adjoint  variable  boundary  condition, 

~ ] . This  is  the  same  expression 

as  given  in  Equation  (6). 

(3)  Integrate  the  state  and  adjoint  differential  equations 

(see  Equations  (5)  and  (6))  back  in  time  to  t„ 

s 

using  the  nominal  controls  u_  and  v^.  Use 

o o 

from  Step  (2)  and  x(t^)  from  Step  (1 ) as  bovindary 
conditions  for  this  integration.  Compute  and 
store  H^|^  and  (also  and  H^l  if  needed) 

along  this  backward  trajectory. 

(I*.)  Update  the  control  histories  % ” S ^ » 

v^  = v^  + Sv  where  Sti  = and  Sv  = 

The  signs  of  ( Su)^  and  ( Sv)^  are  adjusted  so 
that  ( Su)^  and  (H^)J^  az'e  of  opposite  sign  and 
( Sv)^  and  (H^)j^  of  the  same  sign.  Kp  and 
Kj  are  defined  by  Equations  (20)  or  (23)* 

(5)  Repeat  Steps  (1 ) through  (1|.)  above  until 

II  t llH,(t.)ll*4«  • 

eonvergenoe  criterion  la  not  met,  then  confutation 
is  terminated  after  a pre specified  maximum  allowable 
number  of  iterations. 

For  the  problems  considered  in  this  thesis,  the  predicted 
to-go  (t^  - t^),  divided  by  sixty-four,  was  used  as  the 


Integration  step-size  in  the  control  update  algorithm. 
This  mechanization  has  the  feature  of  using  smaller  and 
smaller  integration  steps  as  t^  approaches  t^.  Because 
of  this,  higher  accuracy  of  the  numerical  integration 
method  can  be  ejcpected  as  the  game  progresses. 


( 


A Differential  Dynamic  Programming  Closed-Loop  Control  Law 
The  change  in  the  cost  for  the  time  period  t,,  - t , 

X 8 

due  to  small  deviations  in  the  controls  from  the  nominal,  is 
(Ref  5) 


'■f 

S J ~ f ^ U/.+  Su.,  ~ ) u/,)!/;)  ] 


(25) 


By  letting  A = S J and  performing  the  indicated  integration, 
one  has  the  total  predicted  cost  change.  A,  that  wotild 
result  by  applying  the  controls  Su  and  + Sv.  The 

equivalence  of  Equations  (25)  and  (16)  for  siaall  Su  and 
^v  may  be  shown  by  a Taylor's  series  expansion  throu^ 
first  order  terms  of  Equation  (25)« 

For  a separable  Hamiltonian  (one  which  may  be  separated 
into  a portion  containing  P's  controls  and  a portion  containing 
B's  controls),  one  has 


) 1 . <26) 
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w>ie^-c  v"  = V + Sv  and  = u + Su,  The  predicted  cost 
o o 

change  due  to  Sv  is  A...  and  the  predicted  cost  chango  duo 
to  Su  is  Aj,.  Convergence  at  each  sannling  tine  occurs 
when  the  toual  predicted  cost  change.  A,  is  small  and 


6 A£ 

2 0 

• 

> 

-t  ^ Ap 

^ 0 

• 

(27) 

Equations  (27)  indicate  that  E applies  a control  change 
to  cause  an  increase  in  the  cost  and  P applies  a control 
change  to  cause  a decrease  in  the  cost, 

A DPP  Method  Control  Update  Algoritlin,  For  a free 
final  time  problem  with  no  terminal  state  constraints,  the 
algoritlun  is  suiimiarizcd  as  follov^s: 

(1)  From  the  current  state  and  sa.npling  time  (x(t  ) 
and  t ) integrate  the  stato  equations  forv/ard 

3 

until  j— ►0,  This  establishes  a predicted  final 
state  and  time  (x(t^)  and  t^j.  Use  the  ciirrent 
nominal  control  histories,  u^  and  v^,in  this 
integration. 

(2)  Evaluate  the  adjoint  variable  boundary  condition, 

X(tf)  = 1 , This  is  the  same  expression  as 

given  in  Equation  (6), 

(3)  Integrate  the  state  and  adjoint  differential  equations 
back  in  time  to  t using  the  nominal  controls  u , 

8 O 
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V . Use  from  jLeu  {?.)  and  x(L„)  from  ::ter) 

(1)  as  boimdai’y  conditiuna  foi-  Liiis  inte/^raf ion. 

Alonn  this  backv/ard  trajectory: 

(a)  Compute  and  store  u"  and  v'  which  are  fovind 
from  the  optimality  conditions  given  by 
Equations  (7)  through  (10).  In  many  problems, 
analytic  expressions  for  and  in  terns 
of  the  state  and  adjoint  variables  mny  be 
obtained. 

(b)  Compute  and  using  the  current 

state  and  adjoint  variables  and  the  nominal 
controls  u , v . Compute  H,,  and  H„ 
using  the  current  state  and  adjoint  variables 
and  the  new  controls  u"  , v", 

(c)  Fona  the  equations 


^E  " ^Eold  " ^^Ene:>r  » 
^Pold  ^Pnew 


and 


A , and  Ap  are  integrated  backwards  v;ith  tlie 
state  and  adjoint  differential  equations  from 
the  boundary  conditions  Ag(tp)  = Ap(tp)  = 0. 

(l|.)  Update  the  nominal  control  histories  by  replacing 
u^  with  u and  v^  with  v , 

(5)  Convergence  occurs  when  the  total  predicted  cost 
chanf^e  at  t„,  A(t  ) = A-,(t  ) + Ap(t  ) , is  less 

S S il#  3 13 

than  some  small  number,  and  when  4>A-,(t  ) ^ 0 and 

s 


i 


u 


-t^Ap(tg)  £ 0 
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Note  that  this  DDP  scheme  incorporates  no  check  on 
the  size  of  the  control  corrections  made  on  each  Iteration 
of  the  algorithm.  In  the  application  of  this  method  to  the 
problem  of  Chapter  IV,  It  Is  assvuaed  that  the  nominal  control 
Initially  provided  to  the  DDP  scheme  are  suff Iclently • close 
to  the  optimum  to  obviate  the  need  for  a convergence  control 
method. 

Game  simulation 

Game  computer  simulations  employing  both  the  gradient 
and  combined  gradlent-DDP  control  update  algorithms  use  the 
following  general  set-up: 

(1)  Set  P's  sampling  Interval,  A . 

(2)  Set  E's  non-optlmal  control  sequence,  VjjqnOPT* 

(3)  Establish  reasonable  nominal  control  histories 
u^  , v^  for  use  In  the  control  update  algorithm 
on  the  first  Iteration  at  the  first  sanpllng  time. 

A reasonable  choice  might  be  a control  based  upon 
llne-of-slght  or  proportional  navigation. 

(1|.)  Integrate  the  state  differential  equations  forward 
from  the  given  Initial  conditions,  x(t^),  using 
the  controls 

(5)  When  the  state  sampling  time,  t > Is  reached,  P 
calls  upon  the  control  update  algorithm  (gradient 
or  gradlent-DDP  In  this  thesis). 

(6)  After  updating  his  control,  P flies  open-loop 
until  the  next  sampling  time. 


Computer  simulations  of  the  differential  games  considered 
in  this  thesis  were  run  on  a Control  Data  Corporation  6600 
digital  computer.  The  integration  routines  used  in  the 
control  update  algorithms  eiiq>107  a foxirth  order  Runge>Kutta 
method  to  start  and  then  use  a four  point  Adams -Bashf or th- 
Moulton  predictor  corrector  scheme. 

Algorithm  Implementation  on  a Real-Time  Basis.  Since 
the  control  update  algorithm  requires  a small  but  finite 
amount  of  computational  time,  there  is  a time  lag  between 
the  state  sampling  time  and  the  time  that  P may  actually 
Inqplement  the  updated  control.  This  may  be  pictured  using 
a time  line  as  shown  in  Figure  1.  Note  that  if  P chooses 
a sampling  interval  too  small,  this  may  prevent  implementation 
of  tl^e  updated  control  before  the  next  sampling  time  is 
reached.  This  situation  will  decrease  the  effectiveness  of 
the  control  updating  scheme. 


^ n , Sampling  Interval  ^ 

I 



rt;  I ^ 

®k  ®k+1 

Algorithm 
computation^ 

Time 

»{ ► 

Old  Control  Updated  Control 

Figure  1 . Control  Implementation  Time  Lixw 
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III,  Planar  Relative  Motion  Pursuit -Kvaslon  Game 


Game  Formulation 

Consider  a simple  fixed  end  time  planar  relative  motion 
pxirsult-evaslon  game  Involving  two  constant  thrust  rockets. 
The  geometry  of  the  problem  Is  shown  In  Figure  2.  The 
origin  of  the  X3f  cordlnate  system  Is  centered  at  P and  the 
equations  of  motion  of  E relative  to  P are, 

X = \/)^ 

Tf  cxrox  V- - otm- u. 

y = V'y 

• 

Vy  = Tf  dxn  xr—Tp  , (28) 


The  Initial  conditions  for  this  problem  are 

. x(o)  = iO 

. \/x(o)=  o 

. y(o)=  o 
. \/y(o)=  o 


t 
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(29) 


4/ 


r 
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Tho  payofr  is  taken  to  be  one  hair  the  square  of  the 
final  EP  range, 

j = y'^]]  . (30) 

In  this  problem,  drag  and  gravity  effects  are  neglected 
and  it  Is  assximed  that  both  vehicles  are  point  masses  using 
constEUit  thrust.  The  thrust  levels  used  are  Tp  * 1.0  and 
Tg  - 0.5  . 

Application  of  Necessary  Conditions 

The  Hamiltonian  for  this  problem  is 


H = \ \ [J^c^v-Tpc^^]  + 

^y\/y+  Tpo^^] 


. (31) 


The  adjoint  differential  equations  and  boundary  conditions 


are  given  by  Equations  (6) 
to  be 

and  for 

this  problem  are  fovind 

X 

II 

o 

» 

Xf 

II 

1 • 
X 

f 

0 

II 

o 

• 

II 

1 

■< 

t 

= 0 . (32) 
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Equations  (33)  constitute  an  open-loop  strategy  for 
this  game.  The  TPBVP  given  by  Equations  (28),  (29),  (32), 
(33)  must  be  solved  to  generate  the  solution  to  the 

game. 

With  the  initial  conditions  given  by  (29)  the  optimal 
strategy  is 

to**  = O and  XT**  = 0 0 (34-) 


o 

If  the  evader  (E)  uses  a non-optlmal  control  ^jjouoPT  * 
then  the  pursuer  (P)  must  update  his  control  in  order  to 
take  advantage  of  E's  non-optlmal  play. 

Closed-Loop  Controls 

Analytic  Closed-Loop  Controls.  Analytic  expressions 
for  P's  optimal  closed-loop  controls  are 

M 

U, 

C 


I 


where  X = X end  y = Y , ^ 

A derivation  of  this  control  law  is  provided  in  Appendix  A. 

The  trajectory  obtained  using  the  closed-loop  control 
lew  (35)  will  provide  e besis  for  comparing  the  trajectory 
obtained  by  using  a gradient  closed-loop  control  law. 

Computed  Closed-Loop  Controls.  The  gradient  scheme 
mechanized  to  compute  P's  control  correction,  Su,  is 
given  by  Equation  (23).  A fixed  flight  time  of  I4..5  time 
units  was  used  in  the  computer  simulation  of  this  problem. 

The  control  update  algorithm  for  this  problem  is  not  Implemented 
in  real-time. 

Ihe  convergence  criterion  used  was 
(Hu.(tj)(^£.  and 

If  this  convergence  criterion  was  not  met  then  computation 
was  terminated  a^ter  25  Iterations,  The  game  was  played 
using  various  sampling  intervals  (A)  and  convergence  factors 
(€  ). 


Results 

AweTytic  Solution  vs.  Computed  (Gradient  Method ) Solution. 
The  trajectory  obtained  using  the  gradient  control  update 
sohesie  compared  vei^  well  with  the  trajectory  found  from 
the  analytic  expression  for  the  closed-loop  controls.  The 
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trajaetorles  are  shown  In  Figure  3*  A sampling  Interval 
of  A e O.H4.O6  time  units  and  a convergence  factor  of 
€ =0,1  were  used  In  the  gradient  method  run. 

Variation  In  Cost  with  Convergence  Factor.  The  convergence 
factor,  e.  , is  a qualitative  indicator  of  how  near  the 
computed  solution  is  to  the  optimal  solution.  The  smaller 
the  value  of  , the  closer  the  solution  will  be  to  the 
optimum.  If  ^e  gradient  closed-loop  control  law  is  to  be 
implemented  on  a real-time  basis,  then  the  number  of  iterations 
of  the  algorithm  at  each  sampling  time  must  be  kept  low 
to  minimize  the  computational  time.  Some  accviracy  is  sacrificed 
in  this  effort. 

In  order  to  study  the  degree  of  acciiracy  of  the 
* computed  solution,  the  game  was  played  using  differing 

convergence  factors.  The  results  are  given  in  Table  1. 

Note  from  Table  1 that  the  more  stringent  convergence  criteria 
( £ » 0,01  and  £ = 0,001)  resulted  in  more  iterations  of 
the  algorithm  and  did  not  slgniflccmtly  reduce  the  cost. 

This  result  indicates  that  a closed-loop  gradient  method 
would  provide  reasonably  accvurate  solutions  in  a few  iterations 
if  the  value  of  L is  not  too  small. 

Variation  in  Cost  with  Sampling  Interval.  Using  a 
convergence  factor  of  £ * 0,1  the  variation  in  cost  was 
studied  for  different  sampling  intervals.  The  restxlts 
are  shown  in  Table  2,  The  cost  approaches  the  analytic 

C 
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Table  1,  Variance  in  Cost  with  Convergence  Factor 

Oiil dance  Scheme 

Pinal  Cost 

Number  of  times 
convergence 
criteria  not  met 

Maximum  no. 
of  iterations 
used  at  any 
sampling  time 

Analytic 

1.45226 

n/a 

n/a 

(tradient 
( C *=  0.1  , 

A = 0.14063) 

1.56053 

none 

3 

Gradient 
( t = 0.01  , 

A = O.14063) 

1.54167 

2 

25 

Ch'adlent 
( t = 0.001  , 

A = 0.14063) 

1.54259 

11 

25 

Table  2. 

Variance  in  Cost  with  Sampling  Interva] 

Sampling 
Interval 
( A ) 

IDT* 

10DT 

20DT 

3ODT 

40DT 

50DT 

Cost 

1.487 

1.700 

2,463 

2,406 

2,869 

3.465 

*DT  ■ 4.5/128, 

solution  cost  as  the  sampling  Interval  decreases. 

A real-time  implementation  of  the  gradient  closed- 
loop  control  method  Is  made  In  the  problem  of  the  next 
chapter. 


IV,  Three  Dimensional  Interoeptor-Penetrator  Game 


Game  Formulation 

In  an  Interceptor-penetrator  encounter,  the  penetrator 
(designated  with  an  E)  attempts  to  penetrate  the  defenses 
of  a fixed  target  and  hit  that  target  or  at  least 
maneuver  so  as  to  be  In  a favorable  position  to  hit  the 
target  at  some  later  time.  The  interceptor  (designated  with 
a P)  attempts  to  Intercept  E or  at  least  force  E Into  em 
unfavorable  position  from  which  to  hit  T,  This  type  of 
conflict  may  involve  a bomber  and  a surface-to-air  missile. 

The  conflict  could  also  be  between  a maneuverable  intercontinental 
balllstle  missile  (ICBM)  and  an  anti -ballistic  missile  (ABM) 
missile. 

Consider  a simplified  dynamical  model  of  an  encoxmter 
between  an  ICBM,  (E)  and  an  ABM  (P),  Capital  letters  designate 
E's  state  and  lower  case  letters  designate  P's  state.  The 
geometry  of  this  problem  is  shown  in  Figure  4*  The  constant 
thrust  to  mass  ratios  available  to  E and  P are  T^  and  Tp 
respectively.  The  controls  are  the  angles  v^  and  V2  for  E 
and  and  u^  for  P,  The  first  control  angles  (v^  and  u^ ) 
are  measured  in  the  azimuth  plane  from  the  positive  x^ 
axis  and  the  second  angles  (v^  measured  from  the 

looal  horisontal. 

Scaling,  In  this  problem  the  following  scaling  is  used: 

1 distance  unit  (d.u, ) 'v.  10^  feet 
1 time  tuiit  (t,u, ) 'V'  1 second 


Equations  of  Motion,  The  state  equations  and  Initial 
conditions  are 


X = 

Vx 

. X(0)  = 

0. 

Tf  C-OO/  COO/  v. 

, ^,(0)  = 

.57735 

• 

y = 

Vy 

, /(O)  = 

0. 

II 

Tf  COO' “V"^ 

. l/y(0)  = 

.57735 

• 

i= 

, Z(o)= 

ZO. 

Tf  ^lU/r\  Vj^ 

, \4(o)  = 

-.57735 

e 

— 

Voc 

, /x(0)  = 

2.0. 

• 

Tp  COO/  co^  C»0/  to, 

, v^(o)  = 

0. 

. = 

20. 

Tp  Oi/VNtA', 

II 

0. 

• 

z = 

, zCo)^ 

0. 

^2  = 

, vje?)- 

0. 

The  target  coordinates  are  (X,j,  , , Z^)  = (20  , 20  , 0)  d,u. 

Note  that  the  Initial  conditions  are  such  that  E's 
velocity  vector  at  t = 0 Is  directed  at  T with  a magnitude 
of  1,0  d,u,/t,u,  (this  is  equivalent  to  10,000  feet/second) , 

At  t B 0,  P is  positioned  at  T with  zero  Initial  velocity. 

In  this  problem  It  Is  assumed  that  the  two  vehicles 
are  point  masses  operating  in  a drag  free  environment  with 
constant  thrust  to  mass  ratios.  Further,  It  Is  assumed  that 
the  acceleration  of  gravity  is  negligible  in  comparison 
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to  the  acceleration  capabilities  of  the  vehicles. 

Cost.  The  cost  used  in  this  game  consists  of  one  half 
the  square  of  the  final  EP  range  plus  the  dot  product  of 
E's  velocity  vector  and  E's  line  of  sight  distance  vector 
to  T at  the  final  time.  The  angle  O between  these  two 
vectors  is  indicative  of  the  predicted  ET  miss  distance 
should  E successfully  sxirvive  the  encounter  with  P.  A 
small  value  of  6 at  the  final  time  wotild  indicate  that  E 
is  in  a favorable  position  from  which  to  later  Impact  T. 
Conversely,  a large  value  of  6(t^)  wovild  indicate  that  E 
is  in  a poor  position  from  which  to  hit  T.  Further  discussion 
of  this  aspect  of  the  problem  may  be  found  in  Appendix  B. 

The  cost  is  given  by 

J=  + ( -z)^l  + 

(Xr~X)  Vy  ( Yt-Y)  + 1/2  I . (37) 

E is  the  maximizing  player  and  P is  the  minimizing  player. 

Application  of  Necessary  Conditions 

The  Hamiltonian  for  this  problem  is 


H = Te  Cea Vj  coav,  )ly  Yy  •+  7^  coo-v*  aUsvj 
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The  adjoint  differential  equations  and  boundary  conditions 
are  found  from  Equations  (6)  and  are 


\=  0 

. \ft<)  = 

, ^l4(tf)  ~ Xy-  ~Xf 

>y=  O 

e 

, \(tf)=  ( y-cj-i/y)!^ 

II 

» Xt  “ Xf 

= o 

. >,ft,)=(z-2- Vj)| 

\ . 

> ^T~^f 

II 

o 

» - Xf 

II 

» 0 

i:,  = 0 

, '^^(tf)=  <}  f - Xf 

, 0 

>J=  o 

» 2f  " 2f 

II 

I 

M 

, 0 

n?om  the  optimal  control  conditions.  Equations  (7)  through 
(10),  it  is  fovind  that 


-yr,  — 


' 7»ir^2 


4i/¥tVg  — 

ca*vi  — 


>Vk  + ''V,  '’‘'I 

V,*  ■♦  Tky*  ♦ 


i 

9 C#«-  U/J.  = I 
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In  this  problem,  the  final  time  is  established  when 


HUf)  =0  . 

Equation  (I4.I ) is  equivalent  to 

j = 0 • <42) 

With  the  initial  conditions  given  in  Equations  (36) 
and  the  payoff  given  by  Equation  (37)»  it  was  foxind  that, 
the  optimal  open-loop  strategies  called  for  E to  thrust 
directly  towards  T and  for  P to  thrust  directly  towards  E« 
This  strategy  is  obviously  suicidal  for  E,  hence,  if  E is 
to  have  any  hope  of  destroying  T,  he  must  first  avoid  P, 

Suppose,  in  an  effort  to  evade  P,  E uses  the  non- 
optimal  control  = (0,0)  for  the  duration  of  the 

encounter  with  P.  This  control  is  unknown  to  P.  In  order 
to  account  for  E's  non-optimal  play,  P uses  a closed-loop 
control  law  discussed  in  Chapter  II, 

Closed-Loop  Controls 

The  first  algorithm  used  was  the  gradient  scheme  with 
control  updates  given  by  Equations  (19)  and  (20),  This 
Biethod  was  implemented  on  a real-time  basis.  The  second 
algorithm  used  was  a combined  gradient-DDP  scheme,  ^e 
gradlent-DDP  method  was  implemented  in  a closed-loop  but 
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not  real-time  fashion. 

The  convergence  criterion  used  in  all  zoins  was 

||Hu,(tj||  ^ € and 

llHv(t,)||  C . (43) 

If  this  convergence  criterion  was  not  met  then  conputation 
was  terminated  after  KOUNT^^^  Iterations.  The  game  was 
played  using  various  iteration  cutoff  factors  (KOUNTj^^) 
and  sampling  Intervals  (/^). 

Thrust  to  mass  ratios  were  also  varied  in  this  game. 
Values  of  Tp  range  from  about  93  g»s  (0,3  d.u./t.u,  ) to 
310  g's  (1.0  d.u./t.u.  ).  These  are  not  unreasonable  figures 
for  an  ABM  missile  such  as  the  Sprint  (Ref  6:5)« 

The  initial  nominal  control  guesses  used  were  u^(0)= 
(-135^,35.26°)  and  v^(0)=(45®, -35.26°).  These  values  were 
used  by  the  algorithm  on  the  first  iteration  at  the  first 
sampling  time. 

Results 

Gradient  Method.  The  gradient  closed-loop  control  law 
auide  use  of  Equations  (19)  and  (20)  in  computing  the  control 
corrections  Su  and  ^v.  This  method  was  Implemented  in 
real-time.  In  all  runs,  player  E used  the  non-op tlmal  control 
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'^NONOPT  “ 

The  changes  in  the  cost  and  minlmtun  £P  range  were 
studied  for  various  sampling  Intervals  ( A ) and  Iteration 
cutoff  factors  (KOUNTj^^^).  In  ell  of  these  runs  the 
thrust  to  mass  ratios  were  fixed  at  Tp  = 1.0  ; Tg  = 0,1 
and  the  convergence  factor  was  set  at  € = 0.5  • Por 
purposes  of  discussion,  a minimum  EP  range  of  1,0  d.u.  or 
less  is  scored  as  a "kill"  for  p.  The  resvilts  are  presented 
In  Figures  5 through  6. 

Note  from  these  flgvtres  that  the  minimum  BP  range 
increases  substantially  If  too  small  a sampling  Interval 
is  used.  This  occurs  because  with  very  small  sampling  Intervals 
there  may  not  be  sufficient  time  between  sampling  times 
for  p to  Implement  the  updated  control.  This  effect  Is 
especially  apparent  early  in  the  game  because  the  algorithm 
usually  required  more  Iterations  (and  more  time)  to  meet 
the  convergence  criterion.  For  example.  In  a run  with 
A = O.I4.  and  KOUNTjjj^  = U.,ployer  P was  only  able  to  implement 
the  updated  controls  In  the  last  t.u.'s  (seconds)  of  , 
the  game.  Thla  represents  only  about  35^  of  the  total 
flight  time. 

If  A was  made  too  large  the  cost  and  minimum  EP  range 
increased.  This  Is  caused  by  P not  updating  his  control 
frequently  enough. 


C 


34 


1 . 

— 

□ 

u 

U 

} 

i 

, , _ 

1 

I 

1 

M 

n 

M 

1 

i 

[TO 

i [iS 

1 BKVp^p  1 

■ 

■ 

■ 

ITTvi*! 

WM 

j 

L_, 

! ' 

1 

t , 1 

J 

L . 

L_ 

_J 

1 

~t 

’ i * 

n1 

f'  I 

h ■ 

i ' • 

.-1 

J 

L, 

1 ' 

1 

i 1 

• 

« 

i 

KO 

■■ 

a 

1- 

It  was  found  that  tho  cost  and  mlnlmuia  EP  range  curves 
dropped  to  a minimum  for  a small  range  of  sampling  intervals. 
This  range  extended  from  about  A =0,5  to  A =1,5,  The 
best  overall  results,  from  P*s  standpoint,  were  obtained 
for  a sampling  interval  range  of  about  0,5  to  1,5  and 
iteration  cutoff  factors  (KOUNTjj^)  of  3 or  If., 

Tho  run  with  KOUNTj^j^  = 1 and  A = 0,4  (Figure  5)  gave 
the  lowest  minimum  EP  range  of  any  rvm,  however,  this  was 
an  Isolated  case.  Other  sampling  Intervals  with  = 1 

resulted  in  erratic  behavior  of  the  cost  and  minimvim  EP 
range. 

It  was  found  on  all  z*uns  that  only  one  or  two  iterations 
of  the  algorithm  were  required  at  each  sampling  time  beyond 
about  t^/2.  This  suggests  that  a smaller  A could  have 
been  used  as  the  game  progressed. 

In  order  to  investigate  the  sensitivity  of  the  algorithm 
to  the  initial  nominal  control  guess  and  initial  conditions, 
the  initial  nominal  control  values  and  Initial  conditions 
of  E were  fixed  and  the  position  of  the  target  (and  initial 
position  of  P)  were  changed.  The  results  are  summarized 
in  Table  3*  Note  that  P was  able  to  compensate  and  score 
a "kill”  for  cases  1 and  2 but  not  for  case  3*  In  case  2, 
the  fact  that  the  algorithm  was  able  to  recover  from  the 
relatively  poor  initial  control  guesses  and  allow  P to 
aoore  a "kill”  shows  some  degree  of  insensitivity  of  the 
method  to  poor  initial  control  guesses. 


Factors  Comnon  to  all  Three  Cases: 


Tp  * #3  (93g*o)  A = ,8  ^NONOPT  “ 

% “ (31g'o)  € “ .5  KOUNTj,^  = 3 

Initial  Control  Guesses  “ (-135® #35*26®) 

T„(0)  = ( 1|S*,-3S.26‘’) 

E's  initial  Conditions  X(0)  = 0.  Y(0)  = 0,  Z(0)«20 

V^(0)=. 57735  Vy(0)=* 57735  V2(0)«- 

P's  Initial  Conditions  P located  at  target  with  sero 

initial  ▼elocitp 


Runs  of  tho  game  were  mde  with  various  values  of 

T and  T . The  results  nre  sirniiiari zed  in  Table  k below, 
e p 

Note  that  P was  able  to  score  a kill  for  a fairly  wide 

range  of  values  of  (from  g'a  to  about  +>5»9  g's)* 

o 


Table  k«  Sensitivity  to 

Thrust  Levels 

"p 

T 

e 

Kin  EP 
Rangs(d.u, ) 

t^  (sec) 

1.00  (310.5e's) 

-1.00  (-310.5e's) 

25.656*'" 

6.000 

tr 

- .20  (-62.1  g's) 

. .292 

8,056 

It 

- .10  (-31.1  g's) 

.k2k 

7.636 

It 

0.00  ( 0.0  g's) 

.236 

7.37k 

n 

.10  ( 31.1  g's) 

.173  • 

7.267 

II 

.12  ( 37.3  E’3) 

.377 

7.197 

II 

.Ik  ( k3.5  g's) 

.510 

7.159 

It 

.16  ( k9.7  g's) 

.652 

7.115 

II 

.16  ( i^5.9  g's) 

.911 

7.12k 

II 

.20  ( 62.1  g's) 

1.2k!*'' 

7.06k 

ti 

.kO  (12k.2  g's) 

4.306*'" 

6,600 

II 

.60  (186.3  g's) 

7.30k'' 

6.k89 

Factors  Goimon  to  all  of  the  Above  Cases 


(20  . 20  , 0) 


A = 1,2 

€ = .5 


E has  escaped  P, 


V = (0,0) 

NOKOl’T 


KOUNT, 


MAX 
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Combined  Gradlent-DDP  Me thod  (Not  Real-Time 
Implementation) . In  an  effort  to  achieve  a more  accurate 
aolution  (and  a lower  minimum  EP  range)  to  the  interceptor- 
penetrator  problem,  a guidance  scheme  using  both  the 
gradient  and  DDP  methods  at  each  t^  was  devised.  The 
control  update  algorithm  made  use  of  a maximum  of  10 
iterations  of  the  gradient  scheme  and  then  a maximum  of 
1C  Iterations  of  the  DDP  scheme.  It  was  found  that  the 
DDP  scheme  made  extremely  large  control  cnanges  early  in 
the  encoimter.  Also  during  that  time,  the  predicted  cost 

p 

change  was  on  the  order  of  10  rather  than  zero.  Very 
late  in  the  game  the  method  "settled  down"  but  at  the 
expense  of  a large  predicted  t^  which  resulted  from  the 
poor  control  updates  made  earlier,  A run  using  A =1,0 
t.u.  res\ilted  in  a minimum  EP  range  of  0,455  and  a t^ 

of  12,39  t,u.  This  is  no  Improvement  over  using  the 
gradient  routine  alone. 

In  the  above  mechanization,  it  is  apparent  that  early 
in  the  game  the  nominal  controls  "handed  over"  to  the 
DDP  scheme  by  the  gradient  scheme  were  not  sufficiently 
accurate  for  convergence  of  the  DDP,  This  is  duo  in  part 
to  the  lack  of  any  convergence  control  built  into  the 
DDP  scheme  and  in  .part,  due  to  the  relatively  hl^  thrust 
rockets  being  used  In  the  game.  Because  of  the  high 
thrusts,  a very  small  error  in  a control  angle  results 


in  a large  cost  change  at  the  predicted  t^. 

Another  coiubined  gradient-DDP  method  was  tried  in 
which  the  gradient  routine  alone  was  used  early  in  the  game 
( 0£  t-«9t^  ) with  a ^ » 1*0  t.u,  and  then  the  DDF  routine 
alone  was  used  late  in  the  game  ( »9t^^t  ^ t^  ) with  a 
A s ,062  t,u.  This  resulted  in  t^  = 10.92  t.u.  and 
a minimum  EP  range  of  3*28  d.u.  Thus,  P did  not  score  a 
kill  in  this  case.  Again,  it  was  found  that  DDF  did  not 
converge.  It  is  apparent  that  if  DDF  is  to  be  used  in 
oonjxinotlon  with  the  gradient  scheme  then  DDF  needs  some 
built-in  convergence  control  device.  The  nominal  controls 
handed  over  to  DDP  by  the  gradient  scheme  were  fairly 
close  to  the  optimal  and  yet  with  no  convergence  control 
the  DD?  scheme  failed.  Use  of  the  gradient  method  alone 
provided  better  results  because  of  its  Inherent  stability. 


V,  Conclusions 


It  has  been  shown  that  a closed-loop  control  algorithm 
based  on  a gradient  method  can  provide  reasonably  fast  and 
accurate  solutions  for  some  differential  game  problems. 

The  principle  advantages  of  this  method  are  that  it  Is 
stable,  it  depends  only  on  the  sampled  system  state  and 
not  a reference  trajectory,  and  it  provides  reasonable 
accxiracy  within  a few  iterations.  The  main  disadvantages 
are  that  the  method  does  require  some  degree  of  fine  taming 
in  selecting  the  step-size  matrices  Kp  , and  the  convergence 
factor,  € . Also,  the  gradient  method  does  not  provide  a 
highly  accvirate  solution.  However,  in  some  problems,  speed 
of  computation  is  more  Important  than  high  accuracy.  A 
DDP  method  used  with  the  gradient  method  may  provide  higher 
aocoaracy  but  some  device  needs  to  be  added  to  limit  the 
size  of  the  control  corrections  made  on  iteration.  The 
DDP  method  as  outlined  in  Chapter  II  was  found  to  be  highly 
unstable.  The  gradient  closed-loop  control  law  presented 
in  this  thesis  provides  an  alternative  to  methods  that 
may  be  prove  to  stability  or  convergence  problems. 

Reeommendations « Use  of  a closed-loop  real-time 
gradient  method  on  a problem  with  realistic  dynamics  shooild 
be  tried  and  the  results  compared  to  those  obtained  using 
other  guidance  laws.  Also,  more  work  may  be  done  on  the 
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hybrid  gradient-DDP  scheme  to  achieve  more  accxiracy  of 
the  solution  and  better  convergence  of  the  DDP,  Another 
area  of  interest  is  the  formulation  of  an  interceptor- 
penetrator  duel  between  an  aircraft  and  a surface-to-air 
zolsslle  using  realistic  dynamics. 
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Appendix  A 


Derivation  of  an  Analytic  Cloeed-Loop  Control  Laiv 

An  analytic  expression  for  the  optimal  closed-loop 
control  law  to  bo  used  by  P in  the  problem  of  Chapter  III 
may  be  foxmd  by  noting  that  the  adjoint  variables  (Equations 
(32))  are  linear  in  the  time-to-go  ( *T  = t^  - t).  Also 
it  is  noted  that  the  controls  for  E and  P are  equal  as 
given  by  Equations  (33).  In  order  to  find  analytic  expressions 
for  the  adjoint  variables  to  use  in  (33)  $ one  needs  to 
find  and  Y^,  Eliminating  the  controls  from  the  second 

state  equation  in  (26)  one  has» 

^ ~'^p)  ^ f » (A-1 ) 

where  is  a constant*  Integration  of  (A-1 ) with  respect 
to  ‘T  yields 

- \/x  = Ki(  tf  - t)  . . (A-2) 

Rearranging  gives 

V.  = X = + V„ 

which  may  be  integrated  with  respect  to  't  to  give 


X^“X~  V^x-f  ( t ) 


. (A-3) 


c 


c 


By  substituting  for  from  (A-2)  into  (A-3)  one  has 

Xf  = X-^\/xCtf-t)  . (A-4) 

Perfoming  similar  integrations  for  yields 

Vf  = y + l/y(tf-t)  -+•  , (A-5) 

_l  V 

where  is  a constant  V Xf^ 

Substituting  for  in  (A-4)  and  multiplying  by  yields 


XfYf  =fx-^  \/x(tf  ~t)]  Yf 


(A-6) 


Substituting  for  K2  in  (A-5)  and  mxatiplying  by  gives 

XfYf  =[y^  yy(tf-t)  ] Xf  •+ 

^(T.-T,4  . (A-7) 

Subtracting  (A-7)  from  (A-6)  and  letting 
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y = y Vy(t4-0 


gives 


(A-8) 


xyf=  yx^  , (A-9) 

Equation  (A-9)  is  used  to  obtain  expressions  for  ^ 8Jld 

^vy  in  terms  of  the  current  state  and  time-to-go.  Substitution 

of  and  ^vy  into  Equations  (33)  then  gives 

^ _ — X 

COC.00  - ■ ; 

_ Y 

u/  — V x'  y ^ ’ , (A-10) 

tdiioh  is  an  analytic  closed-loop  control  law. 


Appendix  B 


ABM-ICBM  Duel 

Minimisation  of  the  ET  Mias  Distance,  If  the  ICBM 
(designated  with  an  E)  suocesafxaiy  survives  the  encounter 
with  the  ABM  (designated  with  a F)  then  E will  thrust  so 
as  to  minimise  the  ET  distance,  Assxanlng  that  E can 
thrust  continuously,  the  system  dynamics  are 


W “ TV  ONLV, 

y - Vy 

i = i/j 

* Tf 


(B-1) 


The  initial  conditions  for  this  problem  are  determined  by 
the  final  state  of  E at  the  termination  of  the  EP  enootmter. 
The  cost  is 


HlU  ;r  = i[0<-Xrf+(y-Vr)^'^ 

V 


idiere  Tf  is  established  ^en 


\J  O 


. (B-2) 


. (B-3) 


There  are  no  terminal  state  ooxistralnts  in  this  problem 
fomolatlon.  The  controls,  v*  , are  the  same -as  those 


described  in  Chapter  IV. 


I The  Hamiltonian  for  this  problem  is 

H - cm.\r^cn.v]  + y l/y  •+  CnVi4^yr,-i- 

'^eI/2+  . (b-14.) 


The  costate  differential  equations  and  terminal  botmdary 
conditions  are 


*>x  = 0 ^W-Xr 

'^y=0  , '^y(7>)=  y(Tf)“  Yt 

~"^y  I *^vy(7t]“  0 

The  value  of  the  Hamiltonian  at  the  final  time  is 


W(Tf)=0  . (B-6) 


Application  of  the  optimality  conditions  f-{^  = Q and 


c 


Expresslona  for  the  costates  In  (B-7)  are  found 


t 


k 

i 

f 

k 

t 

t 

f 

\ 

f 


from  (B-5)  and  are 

Xx=  -(xCr,)-XT)(T,-t) 

\v=  - ( y(TfV  Y-r)  (t, -t) 

\=-  ilir,)-2r](rf-t)  . (b-8) 

Equations  forXW-Xr  found  by 

integrating  the  second,  fourth,  and  sixth  state  equations 
with  respect  to  the  time-tb-go  ( Tf  - t )•  Substituting 
these  into  (B-d)  then  using  Equations  (B-6)  in  (b-7) 
after  some  manipulation  yields 

- Y 

^ yz 

_ -X 

-I 

where 

■x  = X - Xt  W (Tf -t) 

7=  Y-Xr  ” 

2=  2'2r-Vi(Trt) 
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c 


(b-10) 


In  order  to  use  (B-9)  and  (&-10),  a value  of  Tf 
must  be  established.  If  it  is  assumed  that  Tf  occurs 
approximately  whan  E impacts  the  earth  then  a series  of 
fixed  time  problems  may  be  solved  where  a guessed  Tf  is 
incremented  until  ^ O • 

Interceptor-Penetrator  Problem  Program  Listing.  The 
following  program  listing  was  used  to  investigate  the 
minimisation  of  the  ET  impaot  distance  should  E sucessfuUy 
avoid  P.  This  same  program  was  used  to  generate  open- 
loop  strategies  for  this  game  using  NS01A  (Ref  7)s 


RR«,T4<),STr:^  O.  T'^602f):^,  VCnN,<50X  U0ft7 

FTN, 

ATTACH,  A,  ^n  ■^<;’n»n'JTIHtS,  in=l'  fit,sm=afit. 

ATTACH, O,  a«;r  r»ni.T9  , in=T76000 
LnPAOV,^,A, 

LGO. 

PPO*;pJ  ( TNOIIT,  OU'PMTjT  Aore:=TMOi)T,TflP«:6=')UTOUn 

<(l2),F(t?)  ,*  JTNV(1?,1?),W  (610) 

CtMHO<  /'>L3</  T-,TP,xt  ,yt,ZT,TF,  5INJ1  ,COS'Jl,SrHU?,CCSU?, 
C*JTHV1,  ro^Vfl,':TN'/?,Cn5 

C THI«;  ?UM  1A3"  WITH  THP  iVAO'P  PLAYING  NONOPTIHALLY 

C USING  rrvjT?0LS  v=(0,n) 

X(l)  : -G. 

X(a)  s -GO. 

>f(3)  I -G. 

X(l»)  : -GO. 

X(5)  = G. 

X(G)  s GO. 

X(7)  = G. 

X(0)  S GO, 

X(P)  s G. 

X (1  0 ) = GO  , 

X(ll)  - -ft. 

X(l?)  = -ftO. 

TF  = I 1.  G3 
N=l? 

nSTFP  = l.£-ft 
GMAX=l  ."G 
ACC  = l.  '•-ft 
NAXFIJX  = 15  0 
IPPINf  = 1 

CALL  X'OIA  (N,X  ,F,AJINV,GSTFP,ONAX,ACC,NAXFUN,IPPlNT,H» 
PCX  = n. 

GO  10  ▼=!,!? 

10  PCK  » PCX  ♦ F(T)**2 
IF(FC<  .5”^,  ACC)  STOP 
CALL  GPTTi^aj(X) 

PNO 

GUSPOj  CALHDKN.X  ,P) 

GINEN5TON  X CM)  ,F  (N)  , Y 

COMMOX  nLO</  TS,TP,XT,YT,ZT,  TF,  SINJl,CnS»»l,SIXU2,CGSU2, 
CSINVl,  rOSVl,SINV?,COSV? 

PXTPPNAL  SLOPP 
00  G I *1,1? 

5 Y{l)'«  n. 

V<2)  * .5773P 
rev)  * .*;773? 

Y(5)  « 70. 

Y(ft)  *-.G7T3ft 
Y(7)  * ?0. 

V«)  1 20. 

TE  * . 1 
TP  * , 3 
XT  * ?0, 

YT  * ? n. 

7T  ■ ) . 

II*  I? 
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HO  in  T=l,l? 

TT=TT».  1 

10  V(II)=y(T) 

’=n. 

Ms?  4 

n - r r/t?3. 

CALL  5 r*^(M,T,Y,nT,CLnp:»n,.T. ,c,n) 

no  ?o  j=i,i?i 

CALL  5T'-3(M,T,Y,nT,SLO'’r,0,.  T.,0,0) 

20  COSTTMM? 

P(l)  = V (17)  *Y  (2)-(Y<  1> -V(?)  ) 

P(?)  = Y(14)*(Y(1)-X’’) 

c'lX)  = Y<15) +V  (4)-{Y(  -V(n)  ) 

= V (1  ?.)  <■  ( V(  7)-YT  ) 

F(5)  = V (17) +Y  (fi.)-(Y(  *5) -Y(ll ) ) 

P(&)  = Y (10)*(Y('?)-y^) 

'CM  = V(i4)-(Y(7)-Y(  1)  ) 

'(S)  = Y(?0) 

P<9)  = Y(?1)-<Y(Q)-Y(3>) 

'CIO)  = Y(?2) 

PCll)  = YC?3)-(Y(ll)  -Y(5)) 

PC12)  = YC?**) 

'HO 

SL0P~(H,T,  Y.OY) 

0IMEH3  TO  I Y CM)  ,OYCM) 

rOMMOY  /Ot.rx/  TT,  TP,XT  ,yt,7T,  TF,  CTMUl  ,C0SU1,SI'III2,C3SU2, 
CCIMVt,  Ff»3Yl  ,9IMV2,C03  V’ 

C E PLAYF  NON-OOTIM4LLY  WITH  CONTPOLC  \Z=(0,0». 

9INV1  = 0. 

C09VI  = 1. 

9INV?  = n. 

COSV2  = l. 

9f«TPl  = -Sn^.T  (Y  (20) '‘•'’♦Y(22)**2) 

CORTP?  s -CDP.T  (S0^TP1*»24-Y  (24)**2) 

CTMlIl  = YC22)/S0PTP1 
COSUl  = Y(20) /SQRTOl 
91NII2  = YC?4)/SQPTP? 

C0SU2  = COP.TOl/Sn^TP? 

OYCl)  = YC2) 

0VC2)  = T'*r09V2*C0SVl 
0YC3)  = YC4) 

0YC4)  = ▼E*C0SV2*9INY1 
0YC5>  = YC&) 

OYC(i)  * TF*STNV2 
0YC7)  * YCS) 

-IVCO)  e TP*:0SU2»C09J1 
0YC9)  = YClO) 
lYClO)  » TP*CnS'J?»9IMUl 
OYCil)  s YC12) 

0YC12)  s TP*SIMU2 
0VC13I  * 0. 

OY(l4»  s -YC13) 

0YC19)  * 0. 

•3V(16)  *-YCl9» 

OYCtC)  * 0. 

OYC16)  * -YCin 
OVC19I  • 0. 

nyc2o»  * -VC19I 
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t 


= n. 

= 

= n. 

= -r(?Y) 


nv(  ?i) 

TY( 

nv(?M 
“K) 

D^TTPaj(Y) 

Y(’4),  Y(l’) 

rCHMOM  /'>LO</  T«-,To,XT  ,v  t , TF,  «?INiJl  ,C05U1 , 51'IU  : DSJ? ♦ 

f'STSVl,  ''0'^Vl,'5TMV2,'^TSy? 

FXrcR^''L  ^LOPC 
TO  r si, 12 
5 Y(T)  s n. 

V(?)  = 

Y(4)  = 

Y(5)  r 21. 

Y(^)  = -,';773'; 

Y(7)  = PI, 

YO)  = Y(7) 

II  = I 2 
TO  in  T=l,12 
T T = T I 

10  Y<ri)  = x(i) 

= r p/(S4, 

T = 0, 

M s 2, 

PI  a ft  OOT(-l.  ) 

PPTNT  inn,T,  JlTiG,U2TET,  VmiG,V2nEG 
PRINT  2ni,  (Y(I ),  1=1,  1 2) 

CALL  5'’T(M,T,Y,OT,SLOP',r),.T,  ,0,0) 

TO  20  J=l,S4 

CALL  5'^EP('«,T,  Y,OT,SL  0"E,0,,  T,,  0,0) 

U1  a ft"'ft’)2(SimJl,COS'Jl) 

M?  a ft  TftN2(STN'J2,CTGU2) 
yi  a ft”^ft‘i2(«;iNyi,CT«;yi> 

72  a ft ''ftM2(5INy2,CTGV2) 

UlOFG  = '»l*inO./oT 
U20EG  = MP*lftO./PI 
VITEG  = >/l*130./PI 
V20EG  a 72*130, /PI 

PRINT  10n,T,'llO£G,IJ2TF' , VinEG,7  2TEG 
PRINT  200,  (Y(I),  1=1,1  2' 

PPRAN;  r=i?f)PT{(Y(l)-Y(  p)  )**2*  (Y(3)-Y  (T)  )**2+(Y  )-Y  ( 11)  ) **2) 

XJ«Y(?  )*(XT-Y(  1)  )fY(V)‘(YT-Y  (3)  ) *Y  ( 6)  • ( 7T-Y  ( 5 ) ) ♦,  5*EP?  ANGE**2 
ETPAN5  P=<»TRT  ( ( Y ( 1) -X T )“ • 2*  (Y  ( 3)  -YT)  *‘2  + (Y  (5)-TT)**2) 

XL  a fPpftNGE 

, 7E  a Sn?P(Y<2)  *»?*Y(4)**?  + Y(S)**2) 

7EOOTXL  a Y(2)*(XT-Y(l))+Y(4)*(YT-Y(3))+Y(6)*C2T-Y(5)) 

THFftCr  a 7'T0TXL/(7"*X.) 

TF(AT?  (TMFACT)  .GT.l,  ) ^hfaCT  * 1. 

XTHETft  a(ACOS(THFftCT) )*100./PT 
PRINT  3m,XJ,£PRAN5E , EPPftNGE  , XTH£T  A 
100  PORNftT  rTiHFa«,F10.'?,  ?y,"U=-,?(F10.5,lX)  ,2X,"7a“,  2 ( FlO  , 5,  IX) ) 
200  rOPNAT  C"GTftTEa-,6(P9.  SIX)  /SX,6  (FR.  >; ,1X) ) 

300  FOPMAT  (••C3ST  = ",P10.T,  2< , "£PR ANGEa-,  F 10 ,5,2X,"E T^AMGE«",  FlO . 5, 
C2X,"'^-«rTfts~,Fio,^,-T'^G2rFS", /) 

20  C0NTI7M- 

CALL  iPNTSS(Y) 

FNO  ^ 


00 

00 

00 


1 


1 

7 


100 

?00 

10 

50  . 


<^tjaor>j  TTvtr 

OTMEM;  V(^4),  X(?4) 

COMHn>|  T<',t3,x’’  ,VT  ,ZT,  TP,  ^IMJl  ,CnS')l,SI'4II^C0‘5')?, 

,'^inV3,30"  V”* 

''O‘^HO'4 /^'>IO/  '^TP 
"yTTP'JfL  Ptnu 

opi*JT*,‘”Mr  polLOWTN';  *P  THI  PPP3inT?0  T'’ftJECTO?V  THftT 
r~  n rrjLinw  TO  T fP  T SUOOr'^^^ULL  V AVOIOEO  n,” 

t>i  = ir<v^(-i.) 

|<K<  = n 
^TP  = ■».  ♦TP 
10  ’ [ =1  ,a 

v(i)  s y(i) 

M=d 

IT  = 3'P/<i4, 

▼ - Tr 

CALL  5 '“T  (H,T,  Y ,nT,"Trm,  0,  ,T.  ,n,P) 

00  10  J=l,54 

OALL  5Tro(^,T,  Y,nT,ETPTJ,0,.  T.,n,0) 

Y1  = A-^AO?(PTN\/l,:nS>/l' 

V?  = A''M?(  ^TN  V?,C0'^Y2» 

VIOEO  = 71*nO./PI 
VZOcG  = V2*130./oT 

IF(K'<'<.=:1.  1)  PRINT  10  0,T,  (Y(L),L=1,5) 

FORMAT  f”TI4E  = ",PP.  5 , 1X,"{X,  YX,  Y,VY,'^,VZ)=",d(P1,5  ,1X)) 
TF(K«.P1.  1)  PRINT  ?0  0,  VIOCG,  V?0'G 

FORMAT  (**71  = •*,  P.15. 9,  PTES”,  ?X  ,"Y2  = ",  01 5. 8 , •*0E '.RE  ES’V ) 

IF(Y(5  ).LE.  0.  O.ANO.KKK.  EO.  1)  5^0= 

CONTI>IUE 

IF(Y(5).LE.0.0)  KKK=KK<4-1 
IF(<«.p,T,i)  GO  TO  50 
OTP  = oTTf,? 

r.O  TO  1 

RFT'JOM 

'NO 

surpojttnp  ptpoikm.t. Y.OY) 

OIMEM5  ton  Y (M)  ,0Y(M) 

COMMON  /PLOK/  TP,  TP,  XT  ,YT,ZT,  TF,  SINOl  ,C0S'J1 , SIMU’,  C0SU2  , 
CSINVl,  POSVl,SIMV2,COSV? 

COMMON /CPUOX  RTF 

XPAR  = Y(l) -XT+Y  (?)  » ( RTF-T) 

VRAP  X YC3)-YTfY(4)*(RrP-T) 

7BAIR  X Y(5) -ZT+Y  (S)  •(  R^P-T) 

«ORRTl  = S1RT(X9AR**2+Y0AR*»2) 

SORRT?  = S09T(SQRRT1**''4ZRAR**2) 

COSVl  s-YRAR/SORPTI 
SIM71  =-YRAR/SORPTl 
COSV?  = S3RRT1/SORRT? 

SINV?  r-TRAR/SO?PT? 

0Y(1)  = Y(2) 

0Y(2)  * TP*C0SV2*C0SY1 
0Y(3)  » Y(«i) 

3Y(4>  = ’•P*S0SV2*SIMY1 
• 0Y<5)  s Y(5) 

0Y(6)  * TE’SINV? 

“NO 
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Appendix  C 


C 


?aia  Listing;  A Closed-Loop  Gradient  Control  Update 


1 - ^7  jT  7'’ If,  r>ov  vt«7 

CTN. 

flT'TftrM  , ft,  ^rr  ▼S:'n=',0'JT  tm's:  , n ='  f tj  , $ ►j=a  ri  t, 

LTV'r  »v,ft, 

'*■'•* ft  *■«  •■tn  ( T>jP;iT  , '•'  I)t-mit  , T ft  I 'PfT  , T P~g.=  ^l)T->  JT) 

OTMtf*  Y f r 1 ?> 

/H_nw'/'P,T-,Tr,  Tru  ST,  ''-L,'J  (?),/( 2)  ( i> ) , 

•^UTd-ft  ,'*),»/T(l'0,2)  ,KK,  ,yT,7T,fS’fi5(15r,'»)  jvsrfl^d^:,?) 

’■P  = . •» 

T£  = , i 

ST  = ft  ro'^(-i  ft 
r «;tT  y/fti'i'S 

TO  ^ r =1 ,1’ 

5 Y(T)  : n. 

Y(?)  : ,^>777'^> 

V(U)  r 

Y(^)  = ?n, 

Y(S)  = -,^777H 
Y(7ft  = ?n, 

Y(T)  r ?T, 

n Gups^  Fi'iftL  Ti^:. 

=11  .^1111 
OT  = r F/l7^, 
vT  = 7 n. 

YT  = 7 r. 

7T  = 3 , 

C IFFplf  O'S  FftMSLTNS  TM"‘'?VftL,  OFL,  TO  '’C 

Ta  = 1. 

0 <;rT  nr  ffftMOPTTMftL  CTMTOOL  S:01)rN:;Z  TO  S'" 

YM0‘I07"(1)  = 0. 

'/N0‘J07  T(->)  = 0. 

C TMr  T'JT'^TftL  MO'^T’JAL  fts*r 

tj(l)  = -lTF.»DT/in. 

•j(7ft  = r-;,  ?F,»oT/i“i, 

W(l)  : 

Y(?)  = -7!^,  ?r-,*oi  7taT. 

C THE  MD'^'lftL  TOMTTOL  Mr'’’P‘?T^S  ‘=’0?  ISE  GRAD  THE  1ST  TIME  ARE 

TO  11  7=i,ir.fft 
•)T(i,i  >=  ii(n 
OTH,?  ft  = U(?) 

\/T(I,l  ft  = Ydft 
in  7T(T,»  ft  = V(?ft 

Ts  = ia 
T = n, 

M = 1? 

uiDET.  = '1(1)71  in. /3i 
U?n-G  = 'K?ft-1  "O./^T 

VIDTG  = 7(1)71  SO, /oi 
Vr'-G  T 7(?)*1  ftO.701 
OOINT  inn,T,  (Y  (T  ft,T  = l ,1  7) 

ORTNT  r»m,unCG,M?0ES  ,71010,  720-3 
C INTEGRATE  tm?  STflT-  rfyjfiTIPMS  FORWftRO  IN  Tl^r 

CALL  T (T,Y,P) 

?n  CALL  RKOe’S(T,Y  ,M,OTft 
UlTEC  = 'ft(lft*l 31./01 
U20EG  * 'l(2ft*l  IO./0T 
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f' 

t 

*.*• 


100 

?00 


300 


5 

10 


?0 


vn-z'*^  = f(i)*i'>o./o! 

v/?nrr.  = 7(?)  •!  /*’! 

«PI*IT  im,T,  (Y  (T  ) , : = 1 

PPIM”  ‘»m,  ’M  TZ';,  ,71  '5 

POP  MU  (/••TY*'*  =••,  ^n,  ^ ,'>y  0 OTftTZ  = *‘,  0,  IK) , 

0/,17Y,  *S  r’A  ( r IX  ) ) 

POPM AT  (•••!=••,?(  rn.“,  ?y>  , "V  =•*,?(  rn,  r,,j.y)  ) 

Yr-.  0 = 

Tc~  <Mr  Tf?  0 ■ 

TP(T.-;p. )V,T  ,L'.’SO<H)  CALL  ''TOOMO  ( T^iTA ’’T ) 

TFC^.  ; p.  Y<;nYL.  A‘:"'.Y  .L't’^ryn)  oall  0»fV0(Y) 

TF(  T.  ; r,  r-Z/i.,  nn,  Y .L'.*'^f'<H)  OALL  SlOQMO  (TFYvjrr;4) 


■5FftLZ  = ~P  INIS^'-TOTA^’T 


YP(T.- fYri_A'', ’■  + OZAL”  )'  "AIL  CUOOATZ 

’PCY,',  r, A^n.T  .l^.^sokm)  p^T'U*, ”P"al  ttmz  soznt  tm 

CIDA  ■)  = ••  ,o“ALT 

ZP’’ A>i;  -=OOPT  ( { V(  i)-v  ( (Y(  H-Y  ( 0)  )»»?4-  (Y  ( t;  )-Y  ( 11)  ) ♦•?) 

yj=Y  (?  )*'  f XY.  V ( 1)  ) 4-Y  ( ;.  )'  ( YT-Y  ( 3)  ) fY  ('i)*  (?T-Y  (-)  ) 4-.  S^F'^^ANGT  **'> 
-T’ am; ( { Y( 1) -XT )- » 3+  (Y  (3)-YY)*^Z  + (Y(?)-yt)»*P) 
noT’U  Yi)o,  X j, 

po=  nY  ("oosTr" ,p  10.  ?Y,»e-p^ AN:;rr», cio.';,?x,"Y’5av,-!r='.^cin, 5) 

IF(T,.  r, -D  r.n  TO  ?n 

"ID 


‘^UP~*0J~Y.|r  Z-?AO(Y) 

OIMZN'  '■0*1  Y (IP  ) , Y«^  (1?  ),  X(Pj  ) ,H(!(150  ,3)  ,HV(l=;i,  ■»)  , OUT  ( 1=5  0 , ?)  , 

covT  (i;  p, '») 

CCHMO'!  /■^LOK/TP  ,y ,t, TO  , T~  , ,-T,  0ZL» 'I  (?  ) , 7 ( 3)  , 7 MO'IOOT ( 3 ) , 

C'JTdZO  ,3),7T(1*0,3)  ,XK,  J",oi  ,XY,YT,ZT,IJ<;TAP(15  0,3)  ,VSTAP(150,2) 
ZXT'PMAL  <Tl0PFF,SL0O‘-0 
KOUMTs  0 


XJDOT. 
nui  MAX 
nU3MA< 
nVlMAX 
TV3MAX 
HUMAXl 
HUMAX3 
H\MAX1 
MV*<AX3 


0.  0 

3.  0*PI/  180. 
3. 0*PT/190. 
3.  n*PT/  190. 
3.  n*PI/190. 


1. 

1. 

1. 

1. 


KounTiKirnTfi 


00  in  T=i,i? 
X5!(T)=  V(T) 


T=TS 

MF=13 

OTFrfT  r-Tc;)  /?,4, 

OALL  5«’Y  (MF,T,XS,0TP,O'.OPcF,  0,.  T.  ,0,0) 

TF=0. 

IF=IFf  1 
JF=TF 

CALL  5 TP-’CMC,!  ,X0,0Tp  ,y'LOP'*F  ,0,  ,T.  ,0,0) 

OODTs(y3(l)-Y«;r))*(xS(?)-xS{9))  + (XS{3)-X5(0))*(X5(U)-XS(10))l- 
C CX3  (*^)  -X3(ll ) ) *(XS(t)  -YO  (1?)  ) 

COOT  = -X0(?)**  3+(XY-yO(l ) )*T  Z*rOS(VT  (JF,  p)  )*ro?  (VY(  JF,  1)  ) 

C-X3  (U)  •••»f(YT-X‘?  (3)  ) *T“»CO?(  7T(  JF,P)  )•  SIM(7T(  JF,l  ) ) 

C-XS  (<^)  ••  ’♦(PT-XO  (3)  ) * T"*SIN(  VT(  jc,3)  ) 

XJOOT  s.  TOOT  ♦ FOOT 
TF(XJD0'-L*XJ00T.  LT.n.  0>  00  TO  ?0 
TF(  JF,  r.r.irO)  00  TO  ?F 


00 


00 

00 


00 

00 

00 

00 

00 

00 

00 

00 

00 

00 

00 

00 

00 
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I 


I 


t 


yjon"^. 

r yjOOT 

GO  TO 

-»n 

2S 

TF  = T 

opTT 

lonn,  X noT,  j'",  rr 

1000 

C09  'lA" 

,..y  J-I^r=“,  Rir,  .1  If  , "TFr'^GlS. 

no  xn 

•^T  = t, 

so 

X(X^) 

= YS(yT) 

X(1  S) 

= xsd  )-xs  (2)-vn(?) 

X(1  4) 

= x2-yc(  1) 

X(1S) 

= XS  ( 3)-XS  (A)  -V  r>'.  > 

XdS) 

= yt-ys  ( Y> 

XCl’’) 

= ys(S)-ys(ii)-x''{<S) 

X(1A) 

s ■'y-ys(5> 

X(D) 

= xs(y)-ys(i) 

X(?0) 

= 0. 

X(?l) 

= XS(2)-XS  (3) 

X(2?) 

= 0. 

X (?S) 

= XS(ll) -XS(G) 

X(24) 

T=tf 

= 1. 

MO=?4 
XJ^  = 

.F 

CTOs-C 

TC.T?) /X  F 

<K=  JF*  1 

CALL  y,RTR,''L"D*B,0,,T,,T,n) 

CO  '»'»  J^=1,J* 

KK  = < y-i 

CALL  ,y  ,OT?,  C'.03*:9,  0,.T.  ,0,0) 

CriMl  r CI'JdjT  (Ky,l)  ) 

RQSMl  = CO'^.  (MT  «<,1) ) 

= ciMfOT  c<y,  “>) ) 

00?(j?  = CO^r«T  (K''f2)  ) 

CINVl  = ^TMC/T  «|<,1 ) ) 

cosvi  = co7(VT  «y,i) ) 

= RTv|(7T  (<«■,?)  » 

rocv?  = cos  ('/T  «<,?) ) 

MU(<K,  1)  =(-y  (?  T»  *sr'i:>  i*y  (2?)  ‘RO^jd  *'^p*rosu? 

MU(  <<,  *»)  =(-y  (2  0)  ‘COC’J  1*  X (22)  ‘ST  NJl)  ♦■'o»CTN')'»f  X ( ?U)  *TP»COSI)2 
MV(<y,  1)  = (-X  (1  .)  ‘RTM'/  1»y  (1*S)  ‘roSVD  *TT‘CRS\/2 

Hvc<y,  **)  =(-yn  *m^vi-y  (i(^)  ‘STmv/d  ‘t-‘ctnv?«-x  ( i»)  •t?*cosv? 

TF(  AOS  ("'l(<y,D)  .'■-T,  Ji|*r  Yi)  = APS  (H'»(K<,  l>  ) 

‘■F(  AOS  (U')(<<,2))  .5T,“M*(\y2)  HMMAX?  = A9S  (HiJ(<<,  ?) ) 

ir(  AO?  (M7(i<y  , I J)  . :.T.  H V'VAXl ) HWMAXl  = A o?  ( H V ( •<<  , 1)  ) 

TFIAO?  (M/{<y,2))  »G'^,MV‘BX2)  HVMAX2  = A OS  (MV  (<<  , 2)  ) 

<*0  CO^TT‘('*=’ 

“P5IL0M  a ,5 

HlCH^Xs'^'KKK,!  )“2>MI)  «y,2)*‘2 
MVCH:<=H'/(KK,  1)**2«-‘<V  (yK,2)“2 
PPIN^‘ SA‘(OLl’lS 

opT'IT  20  0,  -< 

200  POPMf  ("  ^Iic^^.iy  =”,513.  0,  ?X,“H7CM£K=",r,l';,  0/) 

CO  so  jy»i,jp 

OUT  ( J<  ,1  )=A9S(HIJ(  J<,l)‘D'nMAX/MIJ‘1AXl) 

CUT  ( X ,2)sAqS{wu(J<,2)»nu2MAX/HnMAX2) 

OVT(J<  ,l)sA9S(^V^J»^,l)•n71^‘AX/H'/HAXl> 

OVT  ( l<  ,2)=ACS(  •(7(JX,‘’)*r/2‘1AX/HV‘lAX?) 

J<,1)  ,GT.O.)  TJT(JX,1)  =-n'JT(JK,D 
IF(Hl)(  jy,2).GT,n.)  TJTCJK,?)  =-0JT(JK,2) 
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on 


00 


on 


00 

no 

00 

00 


00 

00 

00 


TRHva  .i.T  ,n.)  T'/T(j<,i)  r -n\/T(  K,n 

1)  = ir  (j'<,n  K, I ) 

VJKJN',  *»)  r UT  ( K,”*)  *'"r  ( ) 

■/■^{  IK,  1)  = 7' ( J'',!)  'r  ( K,  1 > 

/T(  JK,  '•)  = \/’(  K,’)  JK,?) 

’T(M'i:  u-K.L-.  ■^•':TL0'I.  el^STLON)  *,0  TO  IQtJ 

Tri 

~p»)TT'l"" 

'*,0  TH  r 

T«?_(V7T  = Ts 

s T“L 

■j'-T'n'i 

">>n 

r(T,v,o) 

HTM-'I'  •fTJ  V (1  I , 

ntW-n-J  /'>Ln</T'>,T- ,Tr,T'',  T'^L^~T,O^L♦'J  (?)  ,V  (2)  ,7 *’0^10 ’’!(?)  , 

CtJTd'^T  ,^)  ,7T  ( I'-n,’)  , K<,  J<^,PT  ,y-  ,yT,  ■^T,US‘^fl='(15n  ,?)  , V?TA5  (150,  ?) 
0(1  ) =r  V(?) 

0(7)  = Tr*-05  (y/v|nMOOT(?))<^3oc;(y^(n"nPT  (D) 

0(3)  = Y(»,> 

P(u)  = T£*~ns  (VMOMOOT'?)  ) »5TM(  VHO  4nor  (1  ) ) 

0(5)  = V(5) 

o(s)  = ~-:»5rN(VN0‘no ’■(?)) 

O (7  ) = Y ( 3 ) 

0(3)  = “o*Cns  (U(?) ) (U(l ) ) 

0(1)  r v(10) 

0(10)  r TO«or)'-(U(?) ) •'"•TM(|t(  1)) 

P(1D  = Y(12) 

0(12)  = To*5IM(IJ(2)  ) 

“m 

*5UqOQJ'^^^r  ?LnP-:r(Mrr,  ,nr) 

OIK'N?  TTI  '^(►»F),  15('«- ) 

COMH')’(  /OLOK/TO  ,Tr,rr,  T'.tsI  as'!’,  OE!L,  U (2) , 7(?) , YMTipor  (2  ) , 
rUTdin  ,2)  , VT(  150  ,2)  ,K<,  Jo,PI  ,XT  ,YT,7'^,USTft:2(15n,o)  ,(/STao  (ISO,  2) 
SS(1)  =*S(2) 

DS(?)  = (VT(  JO,  O,  )*C0S  (7T  (JO,  D) 

SS(1)  = S(U) 

SS(4)  = TP*COS  (»/T(  JO,  2)  ) »SIN  (V7  (JO,  1)) 

SS(S)  r 0(5) 

0?(S)  = (7T(Jo,  2)  5 

OS(T)  = <;(3) 

oS(3)  = To*sns  (t)T(JO,  2>  ) *COS  (IIT  (JO,  D) 

1S(S)  = S(in) 

ns(io)  = TP*sns(iiT(jr,^)  )*oim(mt(jo,i)  ) 

00(11)  - S(l*») 

isd?)  = ro*si»i(MT(  jr,2) ) 

OMl 

SUSOnjTTMr  ri.OPr')(Ml,T,Y,oy) 

OIM-*j;  •rO  I X('-S),r)YM3) 

SOMKIM  /ILOK^'^o,’- -,To,  T'',TSLaOT,'1-L,'l(2),7(2)  ,'/N'Yl0aT(?)  , 
rUTdSO  ,*>) , VTd  50,2)  ,t<K,  JO,  PI  ,XT  ,Yl  , 7T,USTft9(150  ,2)  , VSTA«^(15n,2) 
nX(l)  = X(2) 

<5X(P)  = (vT(<<,  2)  )*COS  Cr  (KK,  1)) 

nxc?)  = x(u) 

nx(4)  = ■':•C')S(7T(<K,'»))-5I^((VT«K,1)) 

')X(S)  = X(S) 

oX(6)  = To*«if(  (VT(K<,  2)  ) 
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r 


c 


“•XCT)  = y(p.) 

ox(  ) = ■^o*f:or(UT(Ky  )*ros(iiT(i«,  1) ) 

''X(T)  = x(in) 

nx(10>  = TP’rO'idIT  (K<  ,•»)  > *ri '!  (U’’(X<,  1)  ) 

"(Xd!)  = X(l?) 

nx(t-»)  = rr'*riM('iT(xy  ,7)  1 

TV(l^)  - 0. 

nx(i<.)  = -x(id 

1X(l‘’>»  = 0. 

^X(le.)  r -y(l5) 

TXd'')  = n, 
nxdi)  = -x(i7) 
nx(n)  = n, 
nx(?o)  = -xdP) 
nx(’H  = 0. 
nx(  '>?)  = -X  (?i ) 
nx(?x)  = 0. 

'IXf?'*)  = -X('»^) 

'I" 

/'>L'V</'P»T  :-',Tr,  T'^,T?:l4  3T,  J (?)t  *J'»*'0®T(?)  , 

rUT(l"0  ,?1  r'/Td  ■^•0  ,?»  ,K'<,  J*:",  OT  ,XT,XT,  7T,  USTftr»(15P,'’)  , V?raP(150, 2) 
KK  = I 

'J(I)  = MT(y<d) 

«l(7)  = 

\/(n  = V''(<<,1) 

V(?5  = V'fKX,?) 

Djrj«jr>>j 


0 


i 


Appendix  D 

Program  Listing:  A Closed-Loop  Gradient -DPP  Control 
Update  Algorithm  (Hot  Real-Time) 
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BRO,T^n,';Tr5  o,  TT60  2n3,nAC  on, '^OX  41^7 

FTN. 

ATTArH,A,  AFI  ▼‘5'IOPOUT  INFS , I0="  FIT  , S N=A  FIT, 

LITRAPY.A, 

LGO. 

0900=*^  M 0AMt^?(TNPir,Q!rPMT,TArrrrIMPilT,TAP~6  = 0l>'^PU^) 

OIM-N'  •^O'J  Yd?), 0(17) 

''OMHO^  /'>LO</'^P,T-,TF,  T5,TSLAST,  H^L , 1)  (? ) , 7 ( 7)  ,7NO‘IO»T(?)  , 

CIIT(  1=^1  ,7)  , v/T(  irn  ,’)  ,<X,  JP,PI  ,XT  ,YT,  ZTjUSTAPdSn  ,7)  , VSrAP(150,2) 

C TMT<?  >n0CPAN  A CO*'OTNrO  GOAOT'NT  ngo  Mrf^f)0 

C (NOT  ?f(VL  TINF)  W^FRI  'PAO  PPOYIOFS  OOP  WITH 

C NOMINAL  OOMTPOL  NTFTOPTFS 

TP  = , ’f 
TF  = . 1 
01  = \ rno(-i . ) 

C SFT  Sr  ATr  ^^ALU^S  AT  T=0, 

00  0 r =1,17 
5 Y(I)  = n. 

Y(7>  s ,07735 
Y(4)  = ,07735 
Y(5)  = 70, 

Y(5)  s -.57735 
Y(7)  = 70. 

YO)  s 70. 

C GIES5  TMF  FINAL  TINF, 

TF  =10  .51111 
OT  = re-/l2B, 

XT  = > 0, 

YT  = ? n. 

■^T  s 0 . 

C OEFIN-:  P*S  SAMPLING  IN’-^OVAL,  OFL,  TO  BE 
H0.  = 1. 

C SET  F' « NONOPTIHAL  OONTPOL  SEQUENCE  TO  5F 
VNONOP’^d)  = 0. 

VMONOPTt-*)  s 0. 

C the  initial  nominal  .CONTROLS  ARE 

U(l)  = -135.*PT/190. 

U(?)  = 35.25-PI/190. 

V(l)  = 40,*PI/180, 

V(?)  = -35. 26*PI/100, 

C the  nominal  control  histories  for  USE  IN  GRAO  THE  1ST  TIME  ARE 
00  10  T=l,150 
UT(I,1  )=  Ud) 

UT(I,? ) = J(2) 

VT(I,l ) = V(l) 

10  VT(I,? ) = V(2) 

TS  * DEL 
T s 0, 

M s 1? 

UlOEG  = Ud)*l80./PI 
U20EC  = U(?)*180./PI 
VIOSG  * V(1)*180./PI 
V20EG  = VC?)»180./PI 
PRINT  100,T,  (Y  {I),T=l  ,1?) 

PRINT  700, UlOEG, U20E5, YIOEG,  V2DFG 
C INTEGRATE  THE  STATE  EQUATIONS  FORHARO  IN  TIM* 

CALL  - CT,Y,P) 
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uin»;G  = M(i)*i«n,/PT 
U?T!G  S '!(?)  *1  i^n./PI 
= 7(1)  »130./»I 
VP'VTG  = /(?)*i3n./oi 
9PJNT  lf)7,T,  (Y  (I), 1 = 1 ,1?) 

ORIH'*’  ?m,!JnF.G,il?-)-';  ,71  nEG,  7?PE5 
PO»MAr  (/••TT'^E  = **tPn.  3 STftTE  = ",  6(cq,5, 1 X), 

r/,l7Yf  **P'S  ST/VTE="»S(  ) 

coPMAr  r’i=",?(Fin,'j,9X)  ,”v  =•’,?(  ^in,  5,2X) ) 

TS0KL=  03 

TS:<M=  0 5 

IF(T  . r.T.n,  «o*TP)  DEL  = .1 

TF(T.;f.T5nxL.ANn.T  .L'.TSCKH)  CALL  GRAP(Y) 

TF(T.*»  F.  •^Sr;<L.  AMn.T  .L-,TSCKH,AMD.TS.GT.0.30*rF)  CALL  OOO(Y) 
TF(T.;*’.  T3CKL.  ANO.T  .L-T.TSCKM)  CALL  CUPPATE 
EPRAn;  F=F3RT  ( (Y(  1)-Y(  7) ) **2+  (Y(  ^)-Y  O)  )**24^(Y(P)-Y(lin  *♦?) 
XJsY(?  )•  (XT-Y  ( 1)  )«^Y(!*>*  (YT-Y  (3)  H-Y(6)*  (ZT-Y(5)  ) «■,  3 *FPR AMGE ** 2 
FTRAN;  '■=31RT  ( ( Y(  D-yr  ) *»?♦  (r  (3)  -YT)  •*2^<  Y(5)-7i’»«*?) 

PRINT  ■»no,XJ,EPRANGE,  r-^PANGE 

POPHAf  (••C3*;T  = “,F10.G,  2<,”EPRAN3E="»F10.5,2X,-£TRANGE=",Fin,5» 

TF(T..  P.TF)  -.o  TO  20 

END 

TUPPQJTTNF  GPAn(Y) 

0IMEN5  TO‘1  Y (I?)  ,XS(l?)»  X (25)  ,H')(150,?)  |HV(150  t 2)  f DUT(  150,2)  f 
CDVT  C15  n,  p) 

COMMOX  /PLOX/TP,TE,TP,TC,TSLAST,nEL»lJ(2),  V(2),7N0M0PT(?)  , 

CUT(15!)  ,?)  ,VT(  150,2)  , K K,  JR,  PI , XT  , YT , Z T,  OST  AR  ( 15  0 ,?)  , V5T  AR(150,2) 
external  5L0PEF,?L0P:  R 
XOUNTr  0 
XjnOT.  =0.0 
OUINAX  = T.0*PI/180. 

OU2HAX  = 3.0‘pI/190, 
nviNAX  = 3.0-PI/180, 

CV2MAX  = 3.0*PI/180. 

MUXAXl  = 1. 

HIMAX?  = 1. 

HVHAXl  = 1. 

HVXAX’  = 1. 

KOUNTs  FO'IXTfl 
DO  10  T=l,12 
XS(T)x  t(T) 

T=TS 

MF»12 

0TF*(TF-T5)/G4, 

CALL  5FT(MF,T,  XS,0TF,  5L 0 °EF,  0 T.  , 0 , 0) 

IF«0 
TFrIFf  1 
JFxIF 

CALL  5T£o(MF,T,X5,0TF,CLnPrF,0,  .T.,0,0) 

OODT*(  Y?  (l)-XS  (7))*  (X5(2)-XS  (8)  )♦  C XS  (3 ) -XS  (9 ) > • (XS(  4) -XS  (10)  ) ♦ 
C(XS(5)  -XC(11>)  ♦(XS(S)  -XS(1?)  ) 

FOOT  s-X9(2)**2^(XT-XS(l))TTETC03(7T  (JF,  R)  ) *:0S  (VT  ( JF,  1 ) ) 

C-X5  (4)  •T2+(YT-XS(3)  )*T”*COS(VT(  JF,2)  »*SIN(VT(  JF,1» ) 

C-X5(5)  **2^(7T-X5(5))  ♦TT*SIN(VT(  JF,?>  ) 

XJOOT  » DOOT  ♦ FOOT 
TF(XJDOTL*XJDOT.LT.n,  0)  GO  TO  25 
TF(  JF,  r.E.150)  GO  TO  ?5 


I"  m 


B 
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> 


L 


XJPOT.  = XjmT 
50  TO  ?0 
?5  ▼F  = r 

OPT'IT  imO,XJOOT,JP,TF 

inoo  po^MAr  r**yjDpT  = ",oi5, 9 "rFr'SGis.  8) 

no  no  FT=i,i2 

no  X«T)  = X5(XI) 

x(in>  s ys(t)-x5  (7)-xF(?) 

X(14)  = XT-X5(1) 

X(15)  = X5(X)-XS(n» -X5(«0 
X(15)  s YT-X5(1) 

Xd*')  X5(5»-X5  (in -X5  (6>) 

X(18)  = -^T-X^C*;) 
x(in)  = x'?(7)-x5(i> 

X(20)  = 0. 

x(?n  = xs(n)-x5(x) 

X(??>  = 0. 

x(?n>  = X5(in-x5(5) 

X(24)  = 0. 

X(?5)  = 0. 

X(26)  = 0. 

T=TF 
•18=26 
X J=  = JF 

OT8s-(  ^P-T5)  /X JF 
XK=  JFf  1 

CALL  5 fT (M8, T, X, nr 8, 5 LOOEBtO,.!,, 0,0) 

00  40  )n  = l,JF 

KK  = <X-1 

CALL  T,X,DT0, SLOPES, n,.T., 0,0) 

SIXUl  » STXdiT  «K,1)) 

COSUl  = CnSdJT  (K<,1) ) 

SIX02  = SIMdJT  (<K,2)  ) 

C0SU2  = COSOT  (KX,2)  ) 

SIXVl  = STN(VT  (KK,1) ) 

COSVl  = COS  (XT  (<K,1)  ) 

SINX2  = SI^)(XT  «X,»)  ) 

COSX?  = C0S(VT  (KK,2)) 

HU(KK,  1)  =(-X(20)  •SI»1'J1«-X(22)  *C0SU1)  •TP*COSU2 

HIKKK,  2)  = (-X(2  n)  *C0SJ  1-X(22)  •SINJl)  •To*SINU2«-X  ( 24)  »TP*COSJ2 

HV(«,  1)=(-X(14)*SINV1+X  (16)  ♦COSVl)  *TE*COSV? 

HVCKK,  ?)  = (-X(14)  *C0SV1-X(16)  •$!  HXl ) ♦TE*SINX2^  X ( 18)  *TE*COSV2 
TF(A85  (H')(<<,1)),GT,4UMAX1)  HUMAXl  = AnS(HU(«,l>) 

TF(  A85  (M')(<K,2))  ,GT.M|jiAX2)  HUMAX?  = ABS  ( Hi)  ( <K,  2)  ) 

1F(A85  (M'/(K<,1))  .GT.HX'IAXl)  HVMAXl  = A»S(HV(«,in 
IF(  A85  (H»/(KK,2))  ,GT,HV‘^AX2)  HVHAX2  = ABSUaMKK,?)) 

40  COXTTXMF 

EPSTLOM  s .1 

MUCH'^<  rM'KKK,!  )**2*MU  «K,2)**2 
HVCHE<=HX(KK,  1)**?*HX  (X<,2)*«2 
PRINT*  ."CUPRENT  SANPLIM5  TIME=**,TS 
PRINT  '»00,HUCHFK,HVC-IEX 

200  FORNAT (-MUCH"K*“,G15. 8, ?X. "K VCH EK=" ,515. 6/) 

00  50  .K  = 1,JF 

OUT  (J<  ,l)sA8S(HU.(JX,l)*‘0i)lf1AX/-1UNAXl> 

0UT(  J<,»)*ARS(‘1U(  J<,»)*DU?MAX/HM'1AX2) 

OVT(J<  ,n*A5S(HV(J<,l)*nvlMAX/HV1AXl) 
ovr  CJ<  ,?)*ARS<HV<JK,2)*0V2HAX/HVNAX2) 

65 


00 


00 


00 


00 

00 

00 

00 


00 

00 

00 


TF<MU(  JK»l),r,T.O.)  nuTCJK,!)  =-0'JT(X,l) 

TF(H!I(  J<,?)  ,r,T,n.)  TJT(JK,?)  s -njT(JK,2) 

IF(HV(  .LT.O.)  TV'fJK,!)  =-nVT(JK,l) 

TF(HV(  J<,2)  ,LT  .0.)  ')VT(j<,?)  = -0VT(J<,2> 

UT(JK,  1)  = U'^{  JK,1)  ♦'?T(  JK,1) 

•IT(J<,  ?)  = UTC  JK,?)  ♦nir(JK,2) 

VT(JK,  1)  = VT(  JK,l)+n7T(  JK,1) 

VT(JK, '»>  = JK,2)*1V’<JK,2) 

tF(HU:m-:<.L*.£oSTLOM,  A'4n,HVCHr<.LE.5‘»STLON)  33  TO  103  00 

TFCKOJMT.GE.O  ) GO  TO  100 
50  COUTi^llc 

GO  TO  r 

100  TSL4GT  = TS 

TS  = r «:*OEL 
RETUO'J 
Ern 

GtP»?OJTT>F  nOP(Y) 
ni-iEMS’^OM  Y<12)»XS(1?)»K  (2f>) 

COH^IO^  /OLO</TP  ,T-,'^‘^»TO,TSLAET,Oe-L,n  (2)  t*7(2) , VN0*40»T(?)  , 

CUTdGO  ,2)  ,»/T(l5n,2)  ,K<,  JPjPI  , XT  ,YT  , ZT,  USTAR  C15  0 ,2)  , VST  AR  (1 53 , 2 ) 
EXT-R'4AL  5L0°E  slope  0 
KOJMTs  n 
XJL  = 3. 

XJ30T.  =0.0 
5 XOUNTr  FO'JNT  + I 

00  10  T=l,l? 

10  XS(I)  = V(T) 

TsTS 

MF=12 

OTF=(TP-T5)/f)i», 

CALL  5*^T(MF,T,XS,0TF,  SLOPEF,  0,,  T,  ,0,0) 

IFsO 

20  TF=IFfl 

JF=TF 

CALL  5T-P('*f,T,XS,0TF-,'^L0PrF,0,  .T,,0,0) 

003T=(  ys(l)-xs  (7))»  (XSf2)-xS  (8)  ) ♦ (XS  (T  )-XS  (9) ) • (XS  (4) -XS  (1 0)  ) ♦ 

C CXS  (5)  -XSdl) ) ^(XStS)  -XS  (12)  ) 

F03T  s-XS(2)  (XT-X^d))  -TE^COSdTtJF,?))  *C3S(VT(  JP,1)  ) 

C-X3  (4)  ••’♦(YT-XS  (3) ) *T-*OOS(  VT(  JP,2I  )*SIN(VT  < JF  ,1) ) 

C-XS  (G)  »*2+(7T-XS  (5)  )*T“*SIN(  yT(  JF,2)) 

XJOOT  * OOOT  ♦FOOT 
TF(XJOOTL*XJOOT.LT.O.  0)  GO  TO  25 
IF(JF,  ) GO  TO  25 

XJ30T.  = XJOOT 
GO  TO  20 
25  tf  * r 

FPRS03  r (XSd)-XS(7)  )**2f(XSC3)-XS(9)  )2*2* 

C(X5(5)  -XSdl))**2 

XJ  = <S(2)»(XT-XSd))  ♦XS(4)*  (YT-XS{3))^ 

CXSC6)*  (2*^-XS(5))  ♦.5‘EPRSOO 
OJATTP  = XJ-XJL 
PRINT  1010, XJOOT, JF,TF 

1000  PCRHAT  ("XJ00T«”,G15.e,~JF.«,  IP,**TF  = ",G15.8) 

no  30  KT*1,12 
30  X«I)  * XSCKI) 

X(13)  * XSC1)-XS(7)-XS(2) 

X(14)  * XT-XS(l) 

XU5)  « X3(3)-XS(9)  *XS(4) 
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X(lfi)  = YT-X«?(X) 

X(17)  = X*5{5)-XS(ll)-X^(»!>) 

X(1  »)  = ■'T-X'?(5) 

X(l<?>  = X«;(7)-X<;  (1) 

X(70)  = 0, 

X<21)  = X’?(?)-X'3n) 

X(?3>  = a. 

x(9^)  = x«:(  11) -x‘?(';) 

X(?4>  = T. 

X(??)  = f). 

X(?6)  =0. 

TsTF 

XJP  = .F 

r)T*»»-(  /X  JF 

<K*  J^’f  1 

f^ALL  5 'T(X^,T,  x,nTl,SLOPr9,0,,T.,f),0) 

90  40  vT  = l,JF 
XK  * <*f-l 

9ALL  ?TF»(M9,T,x,!)T3,  SL  0 B,  3,.  T,  , 0 , 9) 

40  coxrix««- 

90  00  JXsl.J'" 

uT<j<,  1)  s j*;tar(j<,i) 

UTCJX,  * ir>TAP  (J<,?) 

XT< jK,  1)  « vxxapcjK.n 

VTCJX,  7)  * XXTAP(J<*?) 

00  rONTlX**** 

AT5  * X(?5)»X(?«») 

ORIST  7*^n,x(?S),X(?9»  ,*.T?J,njATTF 

?00  FOPHAT  rA£  AT  TS*“f  5.  9 ,2X,  **AP  AT  TS=",  r.lB,  0 , ?X,  •*A=“,  G 15.  8/ 
O-OJ  AT  Tc=-,r,ir„  0/) 

PRINT  XOO.XO'INT 
300  format  (-X0UXT  = -,I5> 

FPSILDN  » ,01 

IF(AB5  (A'^5),lE,FPSIL0M)  GO  TO  ICO 
IFTKOJ^T.GF.B  » GO  TO  100 
GO  TO 

100  PET'JOX 

'NO 

5U?PQJ''TME  F(T,Y,P) 

OIMENSTOM  Y(1?),P(12) 

nOMMOX  /BLO</TP,Tr,TF,  T'5,‘^SLAST,OEL,»J(2)  , V<2J,  YNnMOPT(2»  , 

CIJT(153  ,?)  ,VT(  150,2)  ,<K,JF,  PI  ,XT  ,YT  , 7T,  UST  AR  ( 1 50  ,2)  , X5T  AR  (1 50 , 2 ) 
P(l)  = Y(2) 

p<?)  = -rp^cos  (VNONOPT(?))*COS(  VM0M9PT  <1») 

P(3)  * V(4) 

p(4)  » ''E*cns  (VN0N0PT(2))*SIN(VN0M0PT  (in 

0(5)  * V(5) 

P(5)  s TP*SrM(VN0M0PT(2)) 

P(7>  = Y(8) 

P(S)  » TO»COS  (U(2))*C9S(U(D) 

P(9)  * Y(10) 

P(10)  a TP»C0S(U(2))  •5IM(U(l)) 

P(ll)  * Y(12) 

0(12)  * TP*5lN(iJ(2)) 

EK) 

MUPPQJTIME  5LOPCF(MF.T,5.DS) 

91Mt:N?Tn»(  S(MF),OS(MP) 
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CO‘IHO'4  /^m</TP,T",TC-,  TT,  TSL  A ST,  (2  ) , V (2 ) , >/ M-YJO^T  ( ? ) , 

CUT<  ISn  ,2>  ,\/T  (l*;o,2)  ,<K,  JP,PI  ,XT  ,YT,2T,us‘^A  = (15n  ,2)  ,VSrAP.(15!),2) 
HS(l)  = S(?) 

ns(2)  - ’'PS  (VT(  jF,  2> ) *r:os  ( VT  (jp,  1)) 

SS(1)  = S(»0 

(VT(  JF,  2>  ) *SIN  (VT  (JF,  1)> 

ns('^)  = S(S) 

nS(S)  - T-*STM  (VT( JF,  ?)  ) 

IS(’)  = S(S) 

ns{^)  = TO*~r)S  (UT(  JF,  9)  ) *C0S  (UT  (JF,  1)) 

ns(P)  = s(io» 

ns(in)  = TP*~0S(MT(J=- ,2)  )*SlN(UT(je,  1)  ) 

ns(ii>  = s(i?) 

nSdP)  = T0*SIMUIT(  JF  »’) ) 

PNT 

FLOP~p(Hq,T,x,oy> 

X(iP),nx('1?) 

COHMO<<  /Sl.Ot</TO,T'^,T'^,  TS,  TSLAST,  OSL  » U (2  ) , V ( 2) » VNOMQPT  ( 2 ) , 

CUTdSl  ,?>  ,y/Td^0 ,2)  ,K!<,  JPjPI  »XT  ,YT,  Z‘^,USTA3(l5n  ,’)  , VSTAR(150,2) 
*!Q»PT21  = S3PT  (X(14)**^  + Xd6)**2) 

SQPPTr’  = SQ2T  (SnP2T"  1"*2+X(  la)  **2) 

SIMV1  = X(  lfO/3TP='"l 

C05  71  = X(  14>/STPPTF  I 

SIMV2  = X(ia)/ST='0'"''2 

C05V2  = Sf)<?=TFl/S0^2TE2 

VSTAP(XK,1)  = ATAN2(Snvi,C0SVl  > 

VSTAP(K<,2)  = ATAN2(‘ TMV2,C0SV2) 

SO^RTai  = -SOPT(X(20)  '»*2+X  (22)»*2) 

50PPT3?  = -SOPT(SaPPTPl**2+X  (24)**2) 

TF(snR'»Toi,fo,  0. 0)  r,o  to  i 

SiNtll  = X(22)/SaFP-Pl 

COSUl  = X(  20)/S'lPP^Pl 

SIN'J2  a X(  24)/S0PP'PP 

C0SU2  a SOP.RTPl/SO^RTP? 

IJSTAR(KX,1)  a aTAM2(SIMUl,r0SUl) 

USTAR(Xif,2)  = ATAN2(SI'l'J2,r0SU2) 

SO  TO  *• 

USTAP(XX,l)  = -is5.*pi/iao. 

'JSTAR(KF,2)  = 35,26*PI/iaO. 

OXd»  a X(2) 

0X(2)  a TE*OOS  (VT(KK,  2)  )*COS  (VT  (t«,  D) 

OXC1)  a X(4> 

0X(4)  a TF*COS(VT(«,2))*SIN(VT(KK,l)) 

0XC5)  a Y(S) 

0X(6»  a TF*RIN(VT<«,  2»  ) 

OX(T)  S X(8) 

OXC9  ) a TP*OOS(UT(KX  ,2)  )*n0S(UT(KK,  1)  ) 

0X0)  a XdO) 

OXdO)  a TP*COS(UT(«  ,^>  )^SIN(UT(KX,  1)  ) 

OX(ll)  a X(12) 

0X(12)  a TP*SIN(UT(«,2)  ) 

0X(13)  a 0, 

0X(14)  a -X(13) 

0Xd«5»  a (1, 

OX(l^)  a -X(15) 

0X(17)  a 0, 

OX(l«»  a -Xd7) 

OXdOl  a 0, 


"»x(?0)  = -x(iq) 
nx(2i»  = n, 
nx(’?)  = -x(?i) 
qx(?i»  = n. 
nxc’i*)  = 

T=1  ? 

'^0  m L=l,F. 

T=n-i 

MOLq-  = ■ixfu^xd) 
no  !•>  1=7,1? 

T = T ♦ 1 

Han®  = nx(L)*X(T) 

HN"H'*=  y (11)  *X  (2)  *<(1  45  *TE*C0S{  V"Ti\R(KK:,?)  )*r.n?(\/STAR(<K,l))«- 
CX(13)»  X(  »)  *X  (16)  *T£*:  0“  ( VST4R(K'<,  ?)  ) *SIM(  VSTAR(  <y,  1) ) f 
nx(17)»  X(6)+y  (l‘U*T£*Sri(VST4R(XX,2)  ) 

HNEWP:  y(n>»X('^)*X(’n)'‘TP*C0S(l)STaR(«,2))*Cn3(M«;TlR(<K,l))«- 
CX(?l)*y(10)+X(  22)*TD*onS  (UST  AR(K<,2)  )*«:TM(USTaR  (KK,  1)  ) ♦ 

CX  (21)»  X(  12)  ♦X  ( 24)»To*S’’H(UST  AP(  KK,2)  ) 
nX(?5)  = HOinC-HNiME 
nx(26)  = HOLTP-HNEWP 
RETUPX 
END 

qijqpoj’7H"  r'looaTt 

nOHHOX  /'^LOX/TP  ,T  "♦>?,  T3,  TSLAST,  OEL  , U (2)  , \M  2)  , \/MnHO!»T ( ? ) , 

C'»T(13f)  ,2),  VT(15I),2)  tXK,  JF,PI,XT,VT,ZT,UST6R(15  0 ,2)  , V3T  AR  (150 , 2) 


KK  = 1 

tUl)  = 

IJ(?)  = 

')T(KK,2) 

V(l>  = 

V7(XX,1) 

VC?)  s 
®ETURX 
s’Nn 

V^(<X,2) 
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